Skip to main content

What are the suggestion in how to load tables over 15 millions rows using CData Sync? The data source is ServiceNow and the destination is SQL Server. I changed the sync.exe.config to

<?xml version="1.0" encoding="utf-8" ?>
<configuration>
  <startup>
    <supportedRuntime version="v4.0" /> 
  </startup>
  <!-- You can add some Java JVM parameters here. This is for Java application only. 
  <appSettings>
    <add key="JAVA_OPTS" value="" />
  </appSettings>
  -->
<appSettings> 
    <add key="JAVA_OPTS" value="-Xms2g -Xmx50g"/> 
</appSettings>  
  
</configuration>

Also, I changed the timeout of the jobs to 6200.

I found a solution or workaround.

  1. DBA changed the SQL to simple mode for the first loading of the largest tables.
  2. I added this line  <add key="JAVA_OPTS" value="-Xms2g -Xmx25g"/> to the sync.exe.config file.
  3. In the Jobs task, I changed the Command Timeout to 6200.

I was able to load the two tables over 18 million of rows without any issue after those changes.

Terms and ConditionsCookie settings