Skip to main content

CData Sync

Share product questions and get support for CData Sync

  • 74 Topics
  • 155 Replies
74 Topics
J
JackolasApprentice
asked in CData Sync
CDATA Sync: add semicolons in a transformations SQL script with SQL server as target?

I’m trying to do a transformation after a dataload to a SQL server.The query used is: (the query is tested and works on the SQL server)MERGE INTO [S_Material_Data] AS tgtUSING ( SELECT HASHBYTES('SHA2_256', mat.MatNr) AS HSH_Material, CR_date AS Creation_Date, CASE WHEN mat.CH_Date IS NOT NULL THEN mat.CH_Date ELSE mat.CR_date END AS Changed_On, mat.Mat_Type AS Material_Type, mat.Mat_Grp AS Material_Group, mat.PRD_Hier AS Product_Hierarchy, Mat_Disc AS Material_Description, Mat_DiscU AS Material_DescriptionUp FROM Materials mat LEFT OUTER JOIN Descriptions dsc ON mat.MatNr = dsc.MatNr AND dsc.Lang = 'E' ) AS src ON tgt.HSH_Material = src.HSH_MaterialWHEN MATCHED THEN UPDATE SET tgt.Creation_Date = src.Creation_Date, tgt.Changed_On = src.Changed_On, tgt.Material_Type = src.Material_Type, tgt.Material_Group = src.Material_Group, tgt.Product_Hierarchy = src.Product_Hierarchy, tgt.Material_Description = src.Material_Description, tgt.Material_DescriptionUp = src.Materi

352
J
15 days ago
J
JelleStasNewcomer
asked in CData Sync
Amazon Marketplace Connector

Hi CDATA community, I’m Jelle from Belgium and very new to CDATA Sync. I’m very excited about all what CDATA Sync has to offer. I’m currently working to get our Amazon Marketplace data loaded in our Snowflake instance via Sync.Are there other Sync users who are working with the Amazon Marketplace connector and are willing to discuss and share their experiences?Thanks!RegardsJelle

220
J
1 month ago
S
SlackerApprentice
asked in CData Sync
set default Schema for SQL Server

Is there a way to set a default Schema to default to when saving information into SQL server?  I know how to do it by each table but find my self forgetting from time to time.

432
Ethem Q
1 month ago
L
loisine.ann.mendozaCollaborator
asked in CData Sync
The SQL Error Number is 102, State is 1, Severity is 15, Error is 'Incorrect syntax near 'f8a8d2f'.', Server name is AWDAPPINDB3, Line number is 1.The Token Type is 170

:45:17.636-06:00  1  [42|Q-Id]  [META|Schema] Executed  column schema query: [App_History] Success: 4 results (268 ms)2024-09-10T21:45:17.636-06:00  2  [42|Q-Id]  [EXEC|Messag] Executed query: [SELECT *, IsPseudoColumn FROM sys_tablecolumns WHERE  SchemaName = @schema AND  TableName = @table] Success: (268 ms)2024-09-10T21:45:17.636-06:00  2  [42|Q-Id]  [EXEC|Parsed] Executing query: [SELECT TOP 100000 * FROM [dbo].[App_History] AS [WITH] WHERE [ID] > @pk_b0 ORDER BY [ID] ASC]2024-09-10T21:45:17.636-06:00  2  [42|Q-Id]  [EXEC|Parsed] Parameter: pk_b0 = 0f8a8d2f-1266-4f33-86ed-0d94f446125c2024-09-10T21:45:17.636-06:00  5  [42|Q-Id]  [META|Schema] Engine Invalid object name 'App_History'2024-09-10T21:45:17.636-06:00  3  [42|Q-Id]  [TCP |Send  ] Send Begin - Length: 2742024-09-10T21:45:17.636-06:00  5  [42|Q-Id]  [TCP |Send  ] [SQL |Messag] Query Failed: [SELECT TOP 100000 * FROM [dbo].[App_History] AS [WITH] WHERE [ID] > @pk_b0 ORDER BY [ID] ASC]. Error: The SQL Error Number is 102

908
Ethem Q
2 months ago
L
loisine.ann.mendozaCollaborator
asked in CData Sync
Name Tool ID# not found inside D at [1:97]

2024-09-10T00:52:03.708-06:00    1    [6|Q-Id]    [SQL |Cache ] Cache failed: [500] Could not execute the specified command: Name Tool ID# not found inside D at [1:97]2024-09-10T00:52:03.708-06:00    0    [6|Q-Id]    [SQL |Cache ] Replication Failed. Error:[500] Could not execute the specified command: Name Tool ID# not found inside D at [1:97]2024-09-10T00:52:03.708-06:00    1    [6|Q-Id]    [RealDB:System.Data.CData.SQL]The connection is disconnected.2024-09-10T00:52:03.708-06:00    1    [6|Q-Id]    [RealDB:GoogleBigQuery]The connection is disconnected.2024-09-10T00:52:03.708-06:00    1    [6|Q-Id]    [RealDB:SQLite]The connection is disconnected.2024-09-10T00:52:03.708-06:00    1    [6|Q-Id]    [SQL |Messag] Query Failed: [REPLICATE [tools_data_testing] WITH _id = '5a2DAIBt+eVwYnh0y2b6zA==' SELECT [Access Method] AS [access_method], [Actively Selling] AS [actively_selling], [Actual Deployment Date] AS [actual_deployment_date], [Additional Languages] AS [additional_languages], [AKA N

404
Ethem Q
2 months ago
E
ella.evioApprentice
asked in CData Sync
CData Sync error when creating a source connection to SQL Server

I’m encountering an error in CData Sync when I try to create and test a source connection. The complete error message is Connection open failed: [500] Failed to login 'SERVERNAME', Cannot open database 'DBNAME' requested by the login. The login failed. Login failed for user ‘user’. What is the requirement for the SQL server so that CData can establish a connection? Also, are there any logs in CData we can check that has more details about the error?The documentation does not say anything required from the source other than the server and login credentials.

813
L
2 months ago
S
steven.hicksApprentice
asked in CData Sync
Sage Intacct Sync: tables vs views

We are currently implementing CData to sync to a data warehouse. I’m not non-techy guy on the team and we’re trying to figure out the tables and views that are listed in the Sage Intacct Connector for CData Sync - Data Model.Are these the only tables/views available? Also, what’s the different between a table and a view? Why would a Gldetail and Glentry view, which should have the same columns, be different?Thanks!Steven

511
Ethem Q
2 months ago
J
JTapioApprentice
asked in CData Sync
Post-job event to send email if job finishes 0 rows

I’d like to get information if certain job finishes successfully, but 0 rows are replicated. I found snippet that send email, but how can I write an “if query” that catches only  those scheduled jobs that I want? There is snippet template for that, but I don’t understand how it need to be modified <!-- Enumerate Through Query Results --><api:enum prefix="Query#"><api:set attr="temp.index" value="[_index]" /><api:set attr="temp.query" value="[_value]" /><api:set attr="temp.status" value="[QueryStatus#[_index]]" /></api:enum>  

624
J
2 months ago
S
SalDEnthusiast
asked in CData Sync
Advanced Job Options not working for CData Sync

Hi,I have set Additional Options to TransactionSize=100 and Batch Size to 50 in the Job’s advanced section. My understanding is that setting a Transaction Size will commit the rows at whatever number is assigned, so in my case when 100 records have been cached, those are committed to the database.Unfortunately, the job is not saving any records to the Microsoft SQL destination table for one of the source tables. When I turn on verbose logging, I can see in the logs that 10000+ records have been cached, because I can see the data from those records in the log file. There are other tables which are successfully being populated. Just this one is not. When it errors out at some 20kish row the job ends and there is no data in my destination table. How do I make the job save data it is caching to the table before the error is thrown?

1153
M
3 months ago
Jaclyn
JaclynEmployee
posted in CData Sync
Sync Q3 2024 Release Highlights 

🚀 Exciting News from CData! 🚀 We're thrilled to announce the latest enhancements to CData Sync, designed to elevate your data integration and management capabilities: 🔄 New Reverse ETL Catalog Adds: Featuring new sources like Google BigQuery, PostgreSQL, and Amazon Redshift for more dynamic data integration strategies. 💡 Databricks Boost: Major performance upgrades to our Databricks integration for faster, more efficient data processing. 📥 PostgreSQL Enhancements: Introducing the 'Copy Into' function, simplifying data imports and improving database management efficiency. 🔄 Flexible Sync Modes: Easily switch between CDC and batch processing to better manage your data synchronization tasks.  📚 Full Feature Documentation: For a comprehensive understanding of all new features, visit our Current Release Documentation. Ready to Try These Features?  🆓 Start with a Free Trial.-: Experience the new features firsthand and see the difference they make.  🔝 Already a CData user? Upgrade n

561
D
3 months ago
D
DougN NouriaInfluencer
posted in CData Sync
Documentation improvements

Ran across this while looking at the Snowflake connector for Sync’s documentation.(i.e. help.rst#Snowflake-Source)  C’mon guys, you can do better than this.  ;-)   It’s just an example -- but someone should be taking a pass through all the documentation to look for unhelpful stuff like this, and fix it.

311
E
4 months ago
M
mikelucitoApprentice
asked in CData Sync
Migrating the application database to SQL Server

Hi, Our CData installation started as a proof of concept using the default built-in application database. CData is now a critical part of our data infrastructure and we’d like to migrate the application database to a more robust platform.Is there a tool or process available to migrate the default application database to SQL server?

641
Ethem Q
4 months ago
C
CJIWApprentice
asked in CData Sync
Using Sync pre events to run sync loops

Hello!I know that I can define an out environment variable in pre-job event and use that in the task replication query (documented here and here excellently).I’m probably stretching here but can I define that out-variable to read from a file or any other source and then run the sync task for ALL values of that variable? Kind of a loop? Thanks in advance for you answers!

1631
E
4 months ago
O
obathlaApprentice
asked in CData Sync
Write to sub-directories in Azure DataLake

How can i write to sub-directories in AzureDataLake. I am able to write to parent folder but sub-directories are not working

404
O
5 months ago
S
SalDEnthusiast
asked in CData Sync
Quickbooks to Sql Server Replication Error

Hi all,I am receiving an error when I am trying to replicate a table from QuickBooks to a local SQL Server.“[0] Failed to cache row [126934] The iteratorID "{4853b873-e75a-4f1a-a4d6-2c32253237ad}" is not valid.”See the screenshot below. To try and address this I have: Decreased the Pagesize property in my Quickbooks connection to 50 from 500. Enabled Persistent connections and increased the idle timeout in my Quickbooks Remote Connector from 30 to 120.I restarted the services but none of that worked. Any suggestions?  

11310
S
5 months ago
S
SalDEnthusiast
asked in CData Sync
Creating a

Hi,When I try to create a SQLServer connection for a local SQL Express install, CData Sync is throwing the following error: System error: UnknownHostException - No such host is known (DATA-DEV2\SQLEXPRESS)I am able to connect to the server with SSMS but for some reason CData cannot find it. CData and SQL Express are on the same server. What am I missing? Thanks.

634
Ankit Singh
5 months ago
C
cdata_userApprentice
asked in CData Sync
Replicating data from Netsuite to Snowflake using cData is failing

I am currently using cData Sync to replicate data from NetSuite Tables to Snowflake. However, I am encountering issues with two critical tasks within my job, which consists of 24 tasks in total.The error messages for the failing tasks are as follows: 1.[0] [500] Could not execute the specified command: Can not view record 2.[0] [500] Could not execute the specified command: Failed to cache row [5247] Can not view record StackTrace: at aso230l.nT.Next() at aso230l.mH.Next() at aso230l.mb.Next() at aso230l.mY.Next() at aso230l.mQ.Next() at aso230l.Kz.q(DbCommand , DataTable , IResultSet , ColumnInfo[] , Int32[] , jsb ) These errors are hindering the successful completion of my data replication process, and it is critical for my project that these tasks run smoothly.Please advise .

481
Ethem Q
6 months ago
S
Steve RApprentice
asked in CData Sync
CData Sync Oracle CDC using logminer fails

I am having an issue with my sync installation. I am able to successfully start logminer on the oracle instance and query the results of that logminer session.However, when I run a CDC job from Sync, it will complete the initial data load successfully but then fail on the incremental loads after the initial one with the below error:logminer failed to start If I have it delete the table ot truncate the data then it reloads just fine. It just won’t start logminer to run the CDC loads.Has anyone run into this issue or found a way to resolve this so I can get CDC loads from oracle to sql server working correctly? 

1191
Ankit Singh
6 months ago
Ankit Singh
Ankit SinghEmployee
posted in CData Sync
Replicate Workday WQL Data to Snowflake using Workday Prompts (without errors)

Replicating Workday Data: The ChallengesReplicating Workday HCM and Financials data can be a challenging task in itself, especially when the Workday APIs are so vast, support a variety of data models, and offer different types of authentication mechanisms.With CData Workday connectivity solutions, we simplify the complexities of the backend APIs and offer you a relational view of all your Workday that can be queried using SQL. CData Workday connectors support a variety of Workday connections through:Workday SOAP APIs Workday REST APIs Workday RaaS (Reports-as-a-Service) Workday WQLTo learn more about the seamless Workday connectivity, CData offers, please refer here: https://cdn.cdata.com/help/ASK/sync/Workday-Source.html#connect-to-workday.Powerful Querying through Workday WQLThe Workday WQL service enables high-performance querying of Workday data. Each CData Workday connectivity solution has a built-in SQL Engine that is optimized to work with Workday WQL. As such, CData solutions c

1711
Ankit Singh
6 months ago
Aleksander P
Aleksander PEmployee
posted in CData Sync
Seamless monitoring between CData Sync and Datadog

Given the increasing reliance of companies on their IT infrastructure to maintain competitiveness and fulfill customer needs, effectively managing and monitoring their IT environments can pose a significant challenge in the absence of appropriate tools.Datadog is a cloud-based monitoring and analytics platform that helps organizations gain real-time visibility into their IT infrastructure.This article consists of detailed steps related to enablement of the integration between CData Sync and Datadog.NOTE: This article can be taken into account for other CData applications that auto-generate logfiles from their operational activities (i.e. “CData Arc”, “CData Connect Server”) Step 1: Install the latest version of Datadog Agent (assuming that you already have a Datadog account)On the UI of your Datadog’s instance, hover into “Integrations” and then click “Agent”, in order to access the page that will help you with the installation of the agent.Once you are on the “Agent” page, select your

1472
Aleksander P
6 months ago
Jaclyn
JaclynEmployee
posted in CData Sync
🚀 Exciting News from CData! 🚀 Data Sync Q1 2024 Release Highlights

We're thrilled to announce the latest enhancements to CData Sync, now with even more powerful features to supercharge your data integration and management:  🌐 Sync Cloud - Our renowned Sync product, previously only available on-premise, has now ascended to the cloud! Managed directly by us and unlimited volume allow... experience the full power and scalability of cloud hosting.  💾 S3: Enhanced Incremental Replication - We've significantly enhanced our S3 Incremental Replication Load from Folder feature by fully supporting directory paths in S3. This update allows for more precise and flexible data management, enabling you to efficiently manage and synchronize your data across even the most complex folder structures.  🔄 CDC from Dynamics 365 - Keep your data fresh with our new Change Data Capture (CDC) support for Dynamics 365. Capture and sync changes in real-time, ensuring your data remains current and accurate.  📚 Full Feature Documentation - For a comprehensive understanding

410
Jaclyn
6 months ago
J
JTapioApprentice
asked in CData Sync
CData Sync and Windows Event viewer

My CData Sync servers are running on Azure. I’d like to use Azure Monitor Agent to monitor if CData Sync service is in stopped state. Usually Windows Service monitoring can be queried from Windows System logs finding Event ID 7036. CData Sync seem not to write anything to System Log (or I just not find it). Where should I try to find information if service is stopped?

732
E
6 months ago
J
JTapioApprentice
asked in CData Sync
Task data source settings grayed out in the Sync version 23.4.8843.0

I’ve updated our test environment to latest version 23.4.8843.0 and I noticed that when I try to configure data source settings, I can’t and I get information “Settings are not editable”. Same issue with new tasks and previously created tasks. I can however make settings directly to query-tab and it will work ok. Our production environment is version 23.3.8700.0 and that issue is not there. Data source which I’m using is ElasticSearch

803
Ethem Q
7 months ago
N
Newbie CdataApprentice
asked in CData Sync
How to set Additional Job Options via API Call

We are currently using cdata version .NET Edition - 23.3.8700.0 in our organization and we create jobs through API call. Through API call we are able to create the JOB fine, but we are unable to set StoresUppercaseIdentifiers=true Additional Options property.Any help on this topic is greatly appreciated.  

724
N
7 months ago
A
abhi_quadwaveApprentice
asked in CData Sync
CDC in Cdata Sync creates new record in Destination Table for a record update in Source table

[META|Schema] Skip the drop column operation for column [_cdatasync_deleted]. Can anyone help me understand this issue please. As in the destination table there is a column  _cdatasync_deleted which is being set to null for this new row inserted(Which was supposed to be a UPDATE instead of INSERT in first place)

541
E
7 months ago
Virtual Event: Data Virtualization, Reimagined Ma”arch 14, 2024 style=

Badge winners

Show all badges
Terms and ConditionsCookie settings