Skip to main content

CData Sync

Share product questions and get support for CData Sync

  • 78 Topics
  • 159 Replies
78 Topics
Jaclyn
JaclynEmployee
posted in CData Sync
🎄 Season's Greetings from CData! 🎄 Data Sync Q4 2024 Release Highlights

We're delighted to spread some holiday cheer with the latest enhancements to CData Sync, designed to elevate your data integration and management capabilities this festive season: 🔐 Custom Roles for Enhanced Security: Gain greater control over user access and permissions with our new Custom Roles feature. Tailor roles to fit your organization's needs and restrict the usage of customer-created objects for improved security. 🔄 Dynamics 365 Reverse ETL Destination: Seamlessly sync data back into Dynamics 365, enhancing your CRM and ERP workflows during this busy holiday period. ⚡ Enhanced CDC: Experience faster and more reliable Change Data Capture, ensuring your data is always up-to-date with improved efficiency—just in time for year-end reporting. ❄️ Snowflake Performance Improvements: Enjoy significant performance boosts in our Snowflake integration for quicker data processing and analytics, helping you unwrap insights faster. 📚 Full Feature Documentation: For a comprehensive unders

260
Jaclyn
1 day ago
C
CJIWApprentice
asked in CData Sync
Multiple schedules for a single Sync job?

Is it possible to create multiple schedules for a single Sync job?The use case here is that I'd like to run a job only once per day on some days of a month but then multiple times per day for some other days.One idea that comes to my mind is that I can create two jobs with different schedules, but the problem here is that if a destination table is incrementally synced (which is required for large tables), two jobs will not be able to coordinate.

363
Ethem Q
14 days ago
M
Marcus_SApprentice
asked in CData Sync
How to Use API to enable Automatic Job Retry

How do I use the REST API to enable the automatic job retry option? I’m not seeing that option in the API REST documentation.I am using CData Sync cross platform.

291
Ethem Q
15 days ago
isladavid
isladavidApprentice
posted in CData Sync
Persistent HPC Storage Issues with CData Sync 2023: Seeking Advice

Hi everyone,I’m facing ongoing challenges with HPC storage while using CData Sync 2023, and it’s beginning to impact workflow significantly. The issues include inconsistent storage performance and frequent delays when accessing data, particularly during high-demand processing tasks. These delays not only slow down productivity but also disrupt data synchronization processes.Despite several troubleshooting efforts, including adjustments to storage configurations and network settings, the problems remain unresolved. I suspect there might be compatibility or configuration considerations specific to HPC  environments with CData Sync 2023.Has anyone experienced similar issues with HPC storage when using CData Sync 2023? If so, what solutions or configurations helped improve performance? Insights on any recommended settings, hardware upgrades, or best practices for optimizing CData Sync with HPC storage setups would be incredibly helpful.Any advice from the community is welcome! 

400
isladavid
28 days ago
J
JackolasApprentice
asked in CData Sync
CDATA Sync: add semicolons in a transformations SQL script with SQL server as target?

I’m trying to do a transformation after a dataload to a SQL server.The query used is: (the query is tested and works on the SQL server)MERGE INTO [S_Material_Data] AS tgtUSING ( SELECT HASHBYTES('SHA2_256', mat.MatNr) AS HSH_Material, CR_date AS Creation_Date, CASE WHEN mat.CH_Date IS NOT NULL THEN mat.CH_Date ELSE mat.CR_date END AS Changed_On, mat.Mat_Type AS Material_Type, mat.Mat_Grp AS Material_Group, mat.PRD_Hier AS Product_Hierarchy, Mat_Disc AS Material_Description, Mat_DiscU AS Material_DescriptionUp FROM Materials mat LEFT OUTER JOIN Descriptions dsc ON mat.MatNr = dsc.MatNr AND dsc.Lang = 'E' ) AS src ON tgt.HSH_Material = src.HSH_MaterialWHEN MATCHED THEN UPDATE SET tgt.Creation_Date = src.Creation_Date, tgt.Changed_On = src.Changed_On, tgt.Material_Type = src.Material_Type, tgt.Material_Group = src.Material_Group, tgt.Product_Hierarchy = src.Product_Hierarchy, tgt.Material_Description = src.Material_Description, tgt.Material_DescriptionUp = src.Materi

372
J
1 month ago
J
JelleStasNewcomer
asked in CData Sync
Amazon Marketplace Connector

Hi CDATA community, I’m Jelle from Belgium and very new to CDATA Sync. I’m very excited about all what CDATA Sync has to offer. I’m currently working to get our Amazon Marketplace data loaded in our Snowflake instance via Sync.Are there other Sync users who are working with the Amazon Marketplace connector and are willing to discuss and share their experiences?Thanks!RegardsJelle

240
J
1 month ago
S
SlackerApprentice
asked in CData Sync
set default Schema for SQL Server

Is there a way to set a default Schema to default to when saving information into SQL server?  I know how to do it by each table but find my self forgetting from time to time.

572
Ethem Q
2 months ago
L
loisine.ann.mendozaCollaborator
asked in CData Sync
The SQL Error Number is 102, State is 1, Severity is 15, Error is 'Incorrect syntax near 'f8a8d2f'.', Server name is AWDAPPINDB3, Line number is 1.The Token Type is 170

:45:17.636-06:00  1  [42|Q-Id]  [META|Schema] Executed  column schema query: [App_History] Success: 4 results (268 ms)2024-09-10T21:45:17.636-06:00  2  [42|Q-Id]  [EXEC|Messag] Executed query: [SELECT *, IsPseudoColumn FROM sys_tablecolumns WHERE  SchemaName = @schema AND  TableName = @table] Success: (268 ms)2024-09-10T21:45:17.636-06:00  2  [42|Q-Id]  [EXEC|Parsed] Executing query: [SELECT TOP 100000 * FROM [dbo].[App_History] AS [WITH] WHERE [ID] > @pk_b0 ORDER BY [ID] ASC]2024-09-10T21:45:17.636-06:00  2  [42|Q-Id]  [EXEC|Parsed] Parameter: pk_b0 = 0f8a8d2f-1266-4f33-86ed-0d94f446125c2024-09-10T21:45:17.636-06:00  5  [42|Q-Id]  [META|Schema] Engine Invalid object name 'App_History'2024-09-10T21:45:17.636-06:00  3  [42|Q-Id]  [TCP |Send  ] Send Begin - Length: 2742024-09-10T21:45:17.636-06:00  5  [42|Q-Id]  [TCP |Send  ] [SQL |Messag] Query Failed: [SELECT TOP 100000 * FROM [dbo].[App_History] AS [WITH] WHERE [ID] > @pk_b0 ORDER BY [ID] ASC]. Error: The SQL Error Number is 102

978
Ethem Q
2 months ago
L
loisine.ann.mendozaCollaborator
asked in CData Sync
Name Tool ID# not found inside D at [1:97]

2024-09-10T00:52:03.708-06:00    1    [6|Q-Id]    [SQL |Cache ] Cache failed: [500] Could not execute the specified command: Name Tool ID# not found inside D at [1:97]2024-09-10T00:52:03.708-06:00    0    [6|Q-Id]    [SQL |Cache ] Replication Failed. Error:[500] Could not execute the specified command: Name Tool ID# not found inside D at [1:97]2024-09-10T00:52:03.708-06:00    1    [6|Q-Id]    [RealDB:System.Data.CData.SQL]The connection is disconnected.2024-09-10T00:52:03.708-06:00    1    [6|Q-Id]    [RealDB:GoogleBigQuery]The connection is disconnected.2024-09-10T00:52:03.708-06:00    1    [6|Q-Id]    [RealDB:SQLite]The connection is disconnected.2024-09-10T00:52:03.708-06:00    1    [6|Q-Id]    [SQL |Messag] Query Failed: [REPLICATE [tools_data_testing] WITH _id = '5a2DAIBt+eVwYnh0y2b6zA==' SELECT [Access Method] AS [access_method], [Actively Selling] AS [actively_selling], [Actual Deployment Date] AS [actual_deployment_date], [Additional Languages] AS [additional_languages], [AKA N

414
Ethem Q
2 months ago
E
ella.evioApprentice
asked in CData Sync
CData Sync error when creating a source connection to SQL Server

I’m encountering an error in CData Sync when I try to create and test a source connection. The complete error message is Connection open failed: [500] Failed to login 'SERVERNAME', Cannot open database 'DBNAME' requested by the login. The login failed. Login failed for user ‘user’. What is the requirement for the SQL server so that CData can establish a connection? Also, are there any logs in CData we can check that has more details about the error?The documentation does not say anything required from the source other than the server and login credentials.

953
L
3 months ago
S
steven.hicksApprentice
asked in CData Sync
Sage Intacct Sync: tables vs views

We are currently implementing CData to sync to a data warehouse. I’m not non-techy guy on the team and we’re trying to figure out the tables and views that are listed in the Sage Intacct Connector for CData Sync - Data Model.Are these the only tables/views available? Also, what’s the different between a table and a view? Why would a Gldetail and Glentry view, which should have the same columns, be different?Thanks!Steven

521
Ethem Q
3 months ago
J
JTapioApprentice
asked in CData Sync
Post-job event to send email if job finishes 0 rows

I’d like to get information if certain job finishes successfully, but 0 rows are replicated. I found snippet that send email, but how can I write an “if query” that catches only  those scheduled jobs that I want? There is snippet template for that, but I don’t understand how it need to be modified <!-- Enumerate Through Query Results --><api:enum prefix="Query#"><api:set attr="temp.index" value="[_index]" /><api:set attr="temp.query" value="[_value]" /><api:set attr="temp.status" value="[QueryStatus#[_index]]" /></api:enum>  

624
J
3 months ago
S
SalDEnthusiast
asked in CData Sync
Advanced Job Options not working for CData Sync

Hi,I have set Additional Options to TransactionSize=100 and Batch Size to 50 in the Job’s advanced section. My understanding is that setting a Transaction Size will commit the rows at whatever number is assigned, so in my case when 100 records have been cached, those are committed to the database.Unfortunately, the job is not saving any records to the Microsoft SQL destination table for one of the source tables. When I turn on verbose logging, I can see in the logs that 10000+ records have been cached, because I can see the data from those records in the log file. There are other tables which are successfully being populated. Just this one is not. When it errors out at some 20kish row the job ends and there is no data in my destination table. How do I make the job save data it is caching to the table before the error is thrown?

1253
M
4 months ago
Jaclyn
JaclynEmployee
posted in CData Sync
Sync Q3 2024 Release Highlights 

🚀 Exciting News from CData! 🚀 We're thrilled to announce the latest enhancements to CData Sync, designed to elevate your data integration and management capabilities: 🔄 New Reverse ETL Catalog Adds: Featuring new sources like Google BigQuery, PostgreSQL, and Amazon Redshift for more dynamic data integration strategies. 💡 Databricks Boost: Major performance upgrades to our Databricks integration for faster, more efficient data processing. 📥 PostgreSQL Enhancements: Introducing the 'Copy Into' function, simplifying data imports and improving database management efficiency. 🔄 Flexible Sync Modes: Easily switch between CDC and batch processing to better manage your data synchronization tasks.  📚 Full Feature Documentation: For a comprehensive understanding of all new features, visit our Current Release Documentation. Ready to Try These Features?  🆓 Start with a Free Trial.-: Experience the new features firsthand and see the difference they make.  🔝 Already a CData user? Upgrade n

581
D
4 months ago
D
DougN NouriaInfluencer
posted in CData Sync
Documentation improvements

Ran across this while looking at the Snowflake connector for Sync’s documentation.(i.e. help.rst#Snowflake-Source)  C’mon guys, you can do better than this.  ;-)   It’s just an example -- but someone should be taking a pass through all the documentation to look for unhelpful stuff like this, and fix it.

311
E
5 months ago
M
mikelucitoApprentice
asked in CData Sync
Migrating the application database to SQL Server

Hi, Our CData installation started as a proof of concept using the default built-in application database. CData is now a critical part of our data infrastructure and we’d like to migrate the application database to a more robust platform.Is there a tool or process available to migrate the default application database to SQL server?

691
Ethem Q
5 months ago
C
CJIWApprentice
asked in CData Sync
Using Sync pre events to run sync loops

Hello!I know that I can define an out environment variable in pre-job event and use that in the task replication query (documented here and here excellently).I’m probably stretching here but can I define that out-variable to read from a file or any other source and then run the sync task for ALL values of that variable? Kind of a loop? Thanks in advance for you answers!

1681
E
5 months ago
O
obathlaApprentice
asked in CData Sync
Write to sub-directories in Azure DataLake

How can i write to sub-directories in AzureDataLake. I am able to write to parent folder but sub-directories are not working

404
O
5 months ago
S
SalDEnthusiast
asked in CData Sync
Quickbooks to Sql Server Replication Error

Hi all,I am receiving an error when I am trying to replicate a table from QuickBooks to a local SQL Server.“[0] Failed to cache row [126934] The iteratorID "{4853b873-e75a-4f1a-a4d6-2c32253237ad}" is not valid.”See the screenshot below. To try and address this I have: Decreased the Pagesize property in my Quickbooks connection to 50 from 500. Enabled Persistent connections and increased the idle timeout in my Quickbooks Remote Connector from 30 to 120.I restarted the services but none of that worked. Any suggestions?  

11710
S
6 months ago
S
SalDEnthusiast
asked in CData Sync
Creating a

Hi,When I try to create a SQLServer connection for a local SQL Express install, CData Sync is throwing the following error: System error: UnknownHostException - No such host is known (DATA-DEV2\SQLEXPRESS)I am able to connect to the server with SSMS but for some reason CData cannot find it. CData and SQL Express are on the same server. What am I missing? Thanks.

734
Ankit Singh
6 months ago
C
cdata_userApprentice
asked in CData Sync
Replicating data from Netsuite to Snowflake using cData is failing

I am currently using cData Sync to replicate data from NetSuite Tables to Snowflake. However, I am encountering issues with two critical tasks within my job, which consists of 24 tasks in total.The error messages for the failing tasks are as follows: 1.[0] [500] Could not execute the specified command: Can not view record 2.[0] [500] Could not execute the specified command: Failed to cache row [5247] Can not view record StackTrace: at aso230l.nT.Next() at aso230l.mH.Next() at aso230l.mb.Next() at aso230l.mY.Next() at aso230l.mQ.Next() at aso230l.Kz.q(DbCommand , DataTable , IResultSet , ColumnInfo[] , Int32[] , jsb ) These errors are hindering the successful completion of my data replication process, and it is critical for my project that these tasks run smoothly.Please advise .

551
Ethem Q
6 months ago
S
Steve RApprentice
asked in CData Sync
CData Sync Oracle CDC using logminer fails

I am having an issue with my sync installation. I am able to successfully start logminer on the oracle instance and query the results of that logminer session.However, when I run a CDC job from Sync, it will complete the initial data load successfully but then fail on the incremental loads after the initial one with the below error:logminer failed to start If I have it delete the table ot truncate the data then it reloads just fine. It just won’t start logminer to run the CDC loads.Has anyone run into this issue or found a way to resolve this so I can get CDC loads from oracle to sql server working correctly? 

1271
Ankit Singh
6 months ago
Ankit Singh
Ankit SinghEmployee
posted in CData Sync
Replicate Workday WQL Data to Snowflake using Workday Prompts (without errors)

Replicating Workday Data: The ChallengesReplicating Workday HCM and Financials data can be a challenging task in itself, especially when the Workday APIs are so vast, support a variety of data models, and offer different types of authentication mechanisms.With CData Workday connectivity solutions, we simplify the complexities of the backend APIs and offer you a relational view of all your Workday that can be queried using SQL. CData Workday connectors support a variety of Workday connections through:Workday SOAP APIs Workday REST APIs Workday RaaS (Reports-as-a-Service) Workday WQLTo learn more about the seamless Workday connectivity, CData offers, please refer here: https://cdn.cdata.com/help/ASK/sync/Workday-Source.html#connect-to-workday.Powerful Querying through Workday WQLThe Workday WQL service enables high-performance querying of Workday data. Each CData Workday connectivity solution has a built-in SQL Engine that is optimized to work with Workday WQL. As such, CData solutions c

1781
Ankit Singh
6 months ago
Aleksander P
Aleksander PEmployee
posted in CData Sync
Seamless monitoring between CData Sync and Datadog

Given the increasing reliance of companies on their IT infrastructure to maintain competitiveness and fulfill customer needs, effectively managing and monitoring their IT environments can pose a significant challenge in the absence of appropriate tools.Datadog is a cloud-based monitoring and analytics platform that helps organizations gain real-time visibility into their IT infrastructure.This article consists of detailed steps related to enablement of the integration between CData Sync and Datadog.NOTE: This article can be taken into account for other CData applications that auto-generate logfiles from their operational activities (i.e. “CData Arc”, “CData Connect Server”) Step 1: Install the latest version of Datadog Agent (assuming that you already have a Datadog account)On the UI of your Datadog’s instance, hover into “Integrations” and then click “Agent”, in order to access the page that will help you with the installation of the agent.Once you are on the “Agent” page, select your

1512
Aleksander P
7 months ago
Jaclyn
JaclynEmployee
posted in CData Sync
🚀 Exciting News from CData! 🚀 Data Sync Q1 2024 Release Highlights

We're thrilled to announce the latest enhancements to CData Sync, now with even more powerful features to supercharge your data integration and management:  🌐 Sync Cloud - Our renowned Sync product, previously only available on-premise, has now ascended to the cloud! Managed directly by us and unlimited volume allow... experience the full power and scalability of cloud hosting.  💾 S3: Enhanced Incremental Replication - We've significantly enhanced our S3 Incremental Replication Load from Folder feature by fully supporting directory paths in S3. This update allows for more precise and flexible data management, enabling you to efficiently manage and synchronize your data across even the most complex folder structures.  🔄 CDC from Dynamics 365 - Keep your data fresh with our new Change Data Capture (CDC) support for Dynamics 365. Capture and sync changes in real-time, ensuring your data remains current and accurate.  📚 Full Feature Documentation - For a comprehensive understanding

420
Jaclyn
7 months ago
Virtual Event: Data Virtualization, Reimagined Ma”arch 14, 2024 style=

Badge winners

Show all badges
Terms and ConditionsCookie settings