# Sync Kafka source and max rows

**URL:** <https://community.cdata.com/t/sync-kafka-source-and-max-rows/1067>\
**Category:** CData Sync\
**Tags:** apache-kafka, question, cdata-sync\
**Created:** [April 8, 2025, 9:47am UTC](https://community.cdata.com/t/sync-kafka-source-and-max-rows/1067 "2025-04-08T09:47:38Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![JTapio](https://avatars.discourse-cdn.com/v4/letter/j/838e76/32.png) [@JTapio](https://community.cdata.com/u/JTapio)\
**Post date:** [April 8, 2025, 9:47am UTC](https://community.cdata.com/t/sync-kafka-source-and-max-rows/1067/1 "2025-04-08T09:47:39Z")

</div>

Hi,  
I have Sync version 24.3.9120.0 and I’m using Apache Kafka as source. It’s working fine, except little&nbsp;irritation. When I run task it will replicate only first 150 000 rows and stops after that. Next time I run the task, it replicates 179 000 rows and so on. Row count will increase. Seem to be random

I can run job multiple times and it will continue where it was stopped earlier. Is there way to change this behavior, so that all rows will be replicated at once?

---

<div class="post-metadata">

**Author:** ![Dibyendu](https://avatars.discourse-cdn.com/v4/letter/d/838e76/32.png) [@Dibyendu](https://community.cdata.com/u/Dibyendu)\
**Post date:** [April 9, 2025, 5:56am UTC](https://community.cdata.com/t/sync-kafka-source-and-max-rows/1067/2 "2025-04-09T05:56:22Z")

</div>

Hi ​ @JTapio , could you please share the logs so we can investigate this issue further and assist? To do this, please go into the Job settings, set the Logfile Verbosity to “Verbose”, run the job again, and share the resulting logs with us.

---

<div class="post-metadata">

**Author:** ![JTapio](https://avatars.discourse-cdn.com/v4/letter/j/838e76/32.png) [@JTapio](https://community.cdata.com/u/JTapio)\
**Post date:** [April 9, 2025, 6:28am UTC](https://community.cdata.com/t/sync-kafka-source-and-max-rows/1067/3 "2025-04-09T06:28:16Z")

</div>

Here is one example. Job finished successfully, but didn’t replicate all rows.

---

<div class="post-metadata">

**Author:** ![Dibyendu](https://avatars.discourse-cdn.com/v4/letter/d/838e76/32.png) [@Dibyendu](https://community.cdata.com/u/Dibyendu)\
**Post date:** [April 9, 2025, 8:03am UTC](https://community.cdata.com/t/sync-kafka-source-and-max-rows/1067/4 "2025-04-09T08:03:19Z")

</div>

Hi ​ @JTapio , In the source log file, we can see only 33,000 rows being fetched (screenshot attached). However, all these fetched rows are replicating successfully, so from the replication standpoint, it appears to be working correctly. The most probable cause I can identify relates to the source logs: the page size is set to 1000, and I suspect this size might be insufficient to fetch all the data.

Additionally, please try using the **incremental replication** feature. This might work, as this issue shouldn’t typically occur during full replication.

![ca8496ab-b4a9-4c1c-a50b-30566e7b21ab.png](https://us1.discourse-cdn.com/cdata/optimized/2X/a/a4a37a6ddbd4c39674b5a8dc1dfed84313e333e7_2_690x43.png)

---

<div class="post-metadata">

**Author:** ![JTapio](https://avatars.discourse-cdn.com/v4/letter/j/838e76/32.png) [@JTapio](https://community.cdata.com/u/JTapio)\
**Post date:** [April 9, 2025, 8:54am UTC](https://community.cdata.com/t/sync-kafka-source-and-max-rows/1067/5 "2025-04-09T08:54:30Z")

</div>

I don’t think I can configure incremental replication, because source is Kafka. Kafka consumer offset value keeps track of incremental replication by default (Records can be consumed only once)

---

<div class="post-metadata">

**Author:** ![JTapio](https://avatars.discourse-cdn.com/v4/letter/j/838e76/32.png) [@JTapio](https://community.cdata.com/u/JTapio)\
**Post date:** [April 9, 2025, 8:56am UTC](https://community.cdata.com/t/sync-kafka-source-and-max-rows/1067/6 "2025-04-09T08:56:47Z")

</div>

Source Information&nbsp;edit button is grayed-out

 ![39efff15-bc32-4e60-a0e8-75590076fad3.png](https://us1.discourse-cdn.com/cdata/original/1X/7e6645996a51f4dac185a4ad8f38d813bcbb3522.png)

---

<div class="post-metadata">

**Author:** ![Dibyendu](https://avatars.discourse-cdn.com/v4/letter/d/838e76/32.png) [@Dibyendu](https://community.cdata.com/u/Dibyendu)\
**Post date:** [April 9, 2025, 12:37pm UTC](https://community.cdata.com/t/sync-kafka-source-and-max-rows/1067/7 "2025-04-09T12:37:11Z")

</div>

Hi ​ @JTapio , just to clarify, whenever you perform full replication in CData Sync, the destination data is dropped, and a fresh set of data is fetched from the source.

Since the issue is persistent, I suggest that you contact our support team to help resolve your query.. CData Support:&nbsp;[https://www.cdata.com/support/submit.aspx](https://www.cdata.com/support/submit.aspx)

---

<div class="post-metadata">

**Author:** ![JTapio](https://avatars.discourse-cdn.com/v4/letter/j/838e76/32.png) [@JTapio](https://community.cdata.com/u/JTapio)\
**Post date:** [April 10, 2025, 7:31am UTC](https://community.cdata.com/t/sync-kafka-source-and-max-rows/1067/8 "2025-04-10T07:31:28Z")

</div>

ok, I’ll do it.

If I count rows from the source and from the destination, values&nbsp;are&nbsp;very close, so I don’t think that all the data is fetched every time replication occurs
