Skip to main content
Solved

Suggestions in how to load tables over 15 millions rows using CData Sync

  • December 13, 2024
  • 1 reply
  • 173 views
M
Forum|alt.badge.img

What are the suggestion in how to load tables over 15 millions rows using CData Sync? The data source is ServiceNow and the destination is SQL Server. I changed the sync.exe.config to

<?xml version="1.0" encoding="utf-8" ?>
<configuration>
  <startup>
    <supportedRuntime version="v4.0" /> 
  </startup>
  <!-- You can add some Java JVM parameters here. This is for Java application only. 
  <appSettings>
    <add key="JAVA_OPTS" value="" />
  </appSettings>
  -->
<appSettings> 
    <add key="JAVA_OPTS" value="-Xms2g -Xmx50g"/> 
</appSettings>  
  
</configuration>

Also, I changed the timeout of the jobs to 6200.

Best answer by marodsal

I found a solution or workaround.

  1. DBA changed the SQL to simple mode for the first loading of the largest tables.
  2. I added this line  <add key="JAVA_OPTS" value="-Xms2g -Xmx25g"/> to the sync.exe.config file.
  3. In the Jobs task, I changed the Command Timeout to 6200.

I was able to load the two tables over 18 million of rows without any issue after those changes.

    This topic has been closed for replies.

    1 reply

    M
    Forum|alt.badge.img
    • marodsal
    • Author
    • Apprentice
    • Answer
    • December 18, 2024

    I found a solution or workaround.

    1. DBA changed the SQL to simple mode for the first loading of the largest tables.
    2. I added this line  <add key="JAVA_OPTS" value="-Xms2g -Xmx25g"/> to the sync.exe.config file.
    3. In the Jobs task, I changed the Command Timeout to 6200.

    I was able to load the two tables over 18 million of rows without any issue after those changes.

    State of AI Data Connectivity Report: 2026 Outlook
    Terms and ConditionsCookie settingsAccessibility statement