# Seamless monitoring between CData Sync and Datadog **URL:** \ **Category:** CData Sync\ **Tags:** discussion, linux-unix, cdata-sync, monitoring, datadog, devops\ **Created:** [April 23, 2024, 9:20am UTC](https://community.cdata.com/t/seamless-monitoring-between-cdata-sync-and-datadog/697 "2024-04-23T09:20:14Z")\ **Posts on this page:** 3\ **Page:** 1
**Author:** ![Aleksander\_P](https://sea3.discourse-cdn.com/cdata/user_avatar/community.cdata.com/aleksander_p/32/1520_2.png) [@Aleksander\_P](https://community.cdata.com/u/Aleksander_P)\ **Post date:** [April 23, 2024, 9:21am UTC](https://community.cdata.com/t/seamless-monitoring-between-cdata-sync-and-datadog/697/1 "2024-04-23T09:21:14Z")
Given the increasing reliance of companies on their IT infrastructure to maintain competitiveness and fulfill customer needs, effectively managing and monitoring their IT environments can pose a significant challenge in the absence of appropriate tools. Datadog is a cloud-based monitoring and analytics platform that helps organizations gain real-time visibility into their IT infrastructure. This article consists of detailed steps related to enablement of the integration between CData Sync and Datadog. **NOTE: This article can be taken into account for other CData applications that auto-generate logfiles from their operational activities (i.e. “CData Arc”, “CData Connect Server”)** **Step 1: Install the latest version of Datadog Agent (assuming that you already have a Datadog account)** On the UI of your Datadog’s instance, hover into “Integrations” and then click “Agent”, in order to access the page that will help you with the installation of the agent. ![a307df38-2a66-4a6a-b569-7d7871756e5b.png](https://us1.discourse-cdn.com/cdata/original/2X/a/a72f1e066e0b72cb9b9648abd09774bc14015cfb.png) Once you are on the “Agent” page, select your desired OS (in my case I have used Amazon Linux) and follow the instructions ![03cfa394-39b1-4b29-a60f-ee7d13b23a7c.png](https://us1.discourse-cdn.com/cdata/original/1X/6c9f5724fd313e7e6e64e3136025a8e430efdf0b.png) Give it some time until the machine installs the required resources for the agent, as well as to attach the API\_KEY of your instance within itself. You should see something like below, in case the steps have been followed precisely and everything succeeds: ![c2a42c40-8e33-4148-a200-6d8c43237d79.png](https://us1.discourse-cdn.com/cdata/original/1X/5af4e31befaca99ac5409717588993b73a0c7d1e.png) For a double check, you can also inspect the running services if the Datadog Agent is working properly (as following): ![b754d851-0861-40af-a0eb-73b41f51236c.png](https://us1.discourse-cdn.com/cdata/original/1X/d272f15efe84deec30094024a28b8289b083006f.png) **Step 2: Adding a Log Source** On the sidebar, go to “Logs” then access “Add a Log Source” page: ![6825f765-cc0a-49c1-b88a-92de96f2a8ad.png](https://us1.discourse-cdn.com/cdata/original/2X/7/784ddc9566b2fc4c0e6c18451b5998f52ce89480.png) Within that page, this is where the enablement of the integration will happen. The first thing to be done is to select “Custom Files” from the list of log sources (since CData Sync is not officially an integrator within Datadog). ![0e4ad767-1fc2-45ad-b05b-7d0a483e6e03.png](https://us1.discourse-cdn.com/cdata/original/1X/b5ea1b715e86e856e45dafbeac6b75c1dbecd234.png) As per the instructions of step (2), we must enable log collection in Datadog Agent configuration file (“datadog.yaml” file), in order for the agent to capture Syng logfiles. The configuration file should look something like this: ![7a920b84-b7b7-4a2b-9bf7-8bc82c97f6c1.png](https://us1.discourse-cdn.com/cdata/original/2X/d/d6d9d2a2c14079b11edcc06e07291a737ca2638f.png) Once the “logs\_enabled” parameter is enabled (by removing “#” symbol) restart the service of Datadog Agent. Moving on, it is time to define the path of CData Sync logs, its service name, and the _Source_ (in my case I have used the Apache integrator) ![17f11329-5f3e-4e5d-8ce3-b677d41d7a72.png](https://us1.discourse-cdn.com/cdata/original/2X/7/79d35b180440fcd040ff6c4985aa8937aa7330a6.png) For the **“Path”** element, I have defined the directory where all Sync logfiles exist (as below): ![066b58f6-feb8-41b4-8904-7e9a834d89ad.png](https://us1.discourse-cdn.com/cdata/original/2X/8/8cddf9155e9a23c29569f1a6770921c71891e767.png) For the **“Service”** element, I have defined the name of Sync service: ![03afb760-3d69-48bf-8e39-ef29240bc118.png](https://us1.discourse-cdn.com/cdata/original/2X/f/f769cc4387719b12e47acbb48e016a159e0a1eb1.png) Once these steps are completed, in the Agent’s “conf.d”/ directory, create a new apache.d/conf.yaml file (as following): ![fb723926-69d4-48fd-897b-47c428a13214.png](https://us1.discourse-cdn.com/cdata/original/2X/3/3fcf093b04382e6407f1d5ff5c99ac15fd2ecf25.png) In the end, restart again the Agent and then you can continue shaping the look of your CData Sync logs data. **Example 1: Real-time monitoring of CData Sync job execution (Live Tail)** ![cdef64e5-1b29-4e64-8589-0b34d139fa7f.png](https://us1.discourse-cdn.com/cdata/original/2X/e/e43691f60bc7a175ed72a46a3a75b9211d7b4430.png) **Example 2: CData Sync Dashboard (detailed sync logs, total number of logs, total number of successful/failed jobs, monitoring status)** ![66448057-a934-4f71-b411-c5e97654ca6e.png](https://us1.discourse-cdn.com/cdata/original/2X/1/160db706f137e0655509e91239e3a79d2353d41a.png) ---
**Author:** ![czarny](https://avatars.discourse-cdn.com/v4/letter/c/9e8a1a/32.png) [@czarny](https://community.cdata.com/u/czarny)\ **Post date:** [May 2, 2024, 7:33pm UTC](https://community.cdata.com/t/seamless-monitoring-between-cdata-sync-and-datadog/697/2 "2024-05-02T19:33:20Z")
Thank you, this was really insightful.  I was able to bring in the logs into Datadog from my logs directory.  How did you report successful versus failed jobs?  Each job execution has 3 logs associated with it. ---
**Author:** ![Aleksander\_P](https://sea3.discourse-cdn.com/cdata/user_avatar/community.cdata.com/aleksander_p/32/1520_2.png) [@Aleksander\_P](https://community.cdata.com/u/Aleksander_P)\ **Post date:** [May 3, 2024, 7:26am UTC](https://community.cdata.com/t/seamless-monitoring-between-cdata-sync-and-datadog/697/3 "2024-05-03T07:26:22Z")
@czarny  I am glad you have found this resource helpful for your use-case. Regarding the report of both successful/failed jobs executions, you can play with the parameters of Log Inspector. On my side it looks like following: ![4b743ad3-ecfc-4ffe-b0b2-e4f635f333d6.png](https://us1.discourse-cdn.com/cdata/original/1X/851cbf1b27863a84de5a41aa08664bb7589643cb.png) Log query for successful jobs ![4fac1041-aab4-4e03-9c00-315e859140ed.png](https://us1.discourse-cdn.com/cdata/original/1X/6dec534c5a6c1c32992fb8578535b2d4e338a15b.png) Log query for jobs that contain errors