Data Integration

Hi Team, kindly help me on Jira custom fields are not visible in Cdata connector. ThanksChari

How to remove the last line in flat file using Arc script ??The below script is to add the “END” on the last line but I need to remove the END which is present in the last line of a Flat-file??<arc:set attr="file.file" value="[filepath]" /><arc:call op="fileRead" item="file">  <arc:set attr="tmp.originalBody">[file.file:data]</arc:set></arc:call><arc:unset attr="output.data">[tmp.originalBody]END</arc:set><arc:unset attr="output.filename" value="940_[now()]" /><arc:push item="output" />

I’ve successfully created dozens of tasks to sync certain Salesforce objects to an Oracle destination.  However there is a group of Salesforce objects that are missing when I go to create a new task.  All are created/used by the same 3rd-part ISV app, but the account I am using for connecting to Salesforce is admin and I have no issue interacting with those objects outside of CData Sync.  I’ve read where this could be a cache issue, but I have not been able to find a cache refresh anywhere in CData Sync.  Would anyone have suggestions?  Thanks.

how to remove the first five lines in flat file using Arc script 

Hi.I have incoming invoice CSV files with invoicer’s ID as the only metadata of the invoicer. These are single-line csv files. Let’s call them “invoice.csv”.I have other single CSV file with all of our invoicers’ metadata (including the ID). This file has some 90+k lines. Let’s call this file “invoicers.csv”How can I enrich the invoice.csv file with the correct row from the invoicers.csv file so that the invoice.csv file would contain all the metadata of the invoicer in question?Also, one of the fields in the invoice.csv is a html link to said invoice. How can I download this file with CData Arc?

Hey All,I am trying to adhere to the principle of least permissions. I created a SQL Server Authenticated Login for cdata to use as a service account to SQL Server. I’m not sure what permissions it needs at the database level though? I wasn’t able to find any documentation on the site about minimum permissions cdata sync service account for SQL Server would need.I allow the cdata sync service account to drop and create tables. My guess is that I only need to add the cdata sync service account user to the following database level roles in my data lake.ddl_admindb_datareaderdb_datawriterWhat I am not sure about is whether or not Cdata Sync Service Account needs to have permissions to create Schemas.Thanks

I have a flow where I need to create two csv files and email them using the Email Send connector.I’ve done these many times and it’s super easy...until now.  I need to create and email the first CSV then set a delay (Schedule Connector?) and use a tracked header value from the first part of the flow to create and email another CSV with data from a stored procedure.In other words, once the CSV hits the Input folder of the first Email Notify it sends the email and stops.  Nothing ever shows up in the Output of the Email Notify.I suppose I could use the After Send event to trigger the Schedule, but is their another way to send the first email and continue to follow the flow and send the next email.  The key to this is that I have a tracked header value that must remain through the entire flow, as it’s my stored procedures incoming parameter.Appreciate any input!

I just noticed the EOL announcement for  CData DBAmp versions prior to v22 on this page.  My organization is still on version 4.1.8. I’m interpreting this announcement to mean that version 4.1.8 will continue to work as long as we have a valid license key.  So it will still be running on say, 1/31/2025.  Is this correct? I keep getting surprised by these announcements.  Besides coming to the CDATA site and browsing around, how can I stay up to date on important news?I WILL be talking to my manager about upgrading to the most current version ASAP, but we will need time for lots of testing.

soql passed through dbamp to salesforce using openquery syntax selects from Contact and includes select from child table.    See query below.For the ID specified in the query there are 13 records in the child table which match that ID.  Only 2 records are returned. Would like to know why.  Is this a DBAmp bug?  I did just install the latest DBAmp version.  22.0.8991.0Any other possible explanation? SELECT * FROM  OPENQUERY(SALESFORCE, '  SELECT ID, Email, CLSA_Date_Completed__c, Client_Identifies_Race__c, Latino_Hispanic__c, ExpECM__Race__c, Religious_Spiritual_Affiliation__c, ExpECM__Preferred_Language__c, Secondary_Language_Spoken__c, SACWIS_Case_ID__c, SACWIS_Person_ID__c, Primary_Insurance_Company_HMO__c,  npe01__HomeEmail__c,Preferred_Method_of_Contact__c,Primary_Policy_including_MA__c, Primary_Phone__c, Primary_Phone_is_Mobile__c, Secondary_Phone__c, Secondary_Phone_is_Mobile__c, (SELECT ExpECM__Main_Client__c, Name FR

What are the suggestion in how to load tables over 15 millions rows using CData Sync? The data source is ServiceNow and the destination is SQL Server. I changed the sync.exe.config to<?xml version="1.0" encoding="utf-8" ?><configuration>  <startup>    <supportedRuntime version="v4.0" />   </startup>  <!-- You can add some Java JVM parameters here. This is for Java application only.   <appSettings>    <add key="JAVA_OPTS" value="" />  </appSettings>  --><appSettings>     <add key="JAVA_OPTS" value="-Xms2g -Xmx50g"/> </appSettings>    </configuration>Also, I changed the timeout of the jobs to 6200.

Hey everyone, We’ve just released the Q4 2024 version of CData Arc, and it’s packed with features designed to make managing your trading partners and building workflows even smoother. From a centralized partner management interface, to a revamped UI for quicker workflow creation, to improved connectors and routing capabilities—this release has something for everyone. Key Highlights:• Centralized Trading Partner Management: View and manage all partner connections, documents, and dashboards in one place, making onboarding and optimizing relationships simpler than ever.• Enhanced User Experience: A refreshed UI, built-in disk usage info, and new messageOps capabilities help you work more efficiently. Expect faster workflows, clearer visibility, and a more intuitive platform.• Improved Connectivity: XML Map interface upgrades, more flexible Workspace Send options, and Dro

We're delighted to spread some holiday cheer with the latest enhancements to CData Sync, designed to elevate your data integration and management capabilities this festive season: 🔐 Custom Roles for Enhanced Security: Gain greater control over user access and permissions with our new Custom Roles feature. Tailor roles to fit your organization's needs and restrict the usage of customer-created objects for improved security. 🔄 Dynamics 365 Reverse ETL Destination: Seamlessly sync data back into Dynamics 365, enhancing your CRM and ERP workflows during this busy holiday period. ⚡ Enhanced CDC: Experience faster and more reliable Change Data Capture, ensuring your data is always up-to-date with improved efficiency—just in time for year-end reporting. ❄️ Snowflake Performance Improvements: Enjoy significant performance boosts in our Snowflake integration for quicker data processing and analytics, helping you unwrap insights faster. 📚 Full Feature Docume

Is it possible to create multiple schedules for a single Sync job?The use case here is that I'd like to run a job only once per day on some days of a month but then multiple times per day for some other days.One idea that comes to my mind is that I can create two jobs with different schedules, but the problem here is that if a destination table is incrementally synced (which is required for large tables), two jobs will not be able to coordinate.

How do I use the REST API to enable the automatic job retry option? I’m not seeing that option in the API REST documentation.I am using CData Sync cross platform.

Hello everyone,I’m curious about the security advantages of combining Intel Core M vPro technology with CData’s cloud data connectivity solutions. We know that Intel vPro is built with security features like Intel Active Management Technology (AMT) and hardware-based encryption, which offer enhanced protection for enterprise devices. But how does this integrate with CData's connectors, especially for cloud-based applications and databases?For instance, CData’s JDBC and ODBC drivers provide seamless connectivity to a wide range of cloud data sources. Using these in tandem with Intel security features could potentially streamline secure data access and reduce the risk of unauthorized access during data transactions.I’m particularly interested in how Intel’s built-in remote management and secure boot options could enhance the security of data connections when using CData’s cloud solutions. How do these technologies work together to ensure encrypted

ERP Implementation refers to the process of deploying an Enterprise Resource Planning (ERP) system within a business. ERP systems integrate and manage core business processes, such as finance, human resources, supply chain, and customer relationship management, into a unified platform.

Hi Team, I was calling files from XML map connector to do cross reference from Input values to pick the respective values from list. This function working fine, and from yesterday i am facing the below error “System error: Access to the path 'C:\Users\ligEDIAdmin\Documents\SCJ\SCJCode.xlsx' is denied”  Same function works fine in Production environment, but in Test system i am facing the issue, We have worked with all network / server team and there where no changes made with access / permission levels. Still i am facing the issue, could anyone please help me out by pointing what is to be done to fix this issue. 

How to get the log file from the folderC:\\ProgramData\\CData\\Arc\\workspaces\\[WorkspaceId]\\[ConnectorId]\\Logs\\Sent\\[Date]\\[MessageId]\\[LOG FILE NAME].mdnand send it by email after running the AS2 connector?I tried using the AS2 success connector linked to a "notify" or "send email" or "scripts"I tried in the AS2 connector in the Events tab in "Before send" to find the file and attach it to an emailI tried to read the .mdn file in batch mode and have the result in the output so I could create the attachmentall of them without success, is it possible to do this?

I’m using an Excel connector to pass a spreadsheet into a Script connector for further processing.The Excel input contains columns of the form:  A: B CIn the Script connector, I try to reference it in an xpath like this:  xpath([A:_B_C])But I get the “attribute does not exist” error. I need to deal with or escape that colon character somehow, I just haven’t been able to find where in the docs how to do that yet.Any suggestions?Thank you!

I’ve been using _log.info as a way to debug scripts. This makes log entries I’m wondering if it’s possible to insert log entries in the individual message logs? It would be more convenient to do it that way than going over to the application log every time I want to inspect the data. 

Hi, Where can we find the Changelog of the different Arc versions?

I’m trying to do a transformation after a dataload to a SQL server.The query used is: (the query is tested and works on the SQL server)MERGE INTO [S_Material_Data] AS tgtUSING ( SELECT HASHBYTES('SHA2_256', mat.MatNr) AS HSH_Material, CR_date AS Creation_Date, CASE WHEN mat.CH_Date IS NOT NULL THEN mat.CH_Date ELSE mat.CR_date END AS Changed_On, mat.Mat_Type AS Material_Type, mat.Mat_Grp AS Material_Group, mat.PRD_Hier AS Product_Hierarchy, Mat_Disc AS Material_Description, Mat_DiscU AS Material_DescriptionUp FROM Materials mat LEFT OUTER JOIN Descriptions dsc ON mat.MatNr = dsc.MatNr AND dsc.Lang = 'E' ) AS src ON tgt.HSH_Material = src.HSH_MaterialWHEN MATCHED THEN UPDATE SET tgt.Creation_Date = src.Creation_Date, tgt.Changed_On = src.Changed_On, tgt.Material_Type = src.Material_Type,

I have a SQL agent job running SF_Mirror for a single object every 15min. When the job runs I can see the DBAmpAZ.exe process restart and I get CPU spikes to 80-100% for the duration of the run.  The job generally runs in about 30 sec.Is there anything I can do to cap its CPU usage, or anything I can look at changing to prevent it from spiking that high? 

Hi, Original question:When creating a simple webhook and calling it using curl, the webhook returns an error about “application/x-www-form-urlencoded”.This is resolved by setting the correct Content-Type header to either application/json or application/xml as configured in the Connector. Follow-up question (am not able to update the title of this post...): Can the webhook return to the requestor immediatly with a 200 upon creating the Output message, so that the requester doesnt have to wait for the full flow behind the wehbook to complete?

Hi Team, I have a requirement, where i have a standard JSON body which need to be post every 10 mins to API endpoint , as response to post i will be getting the Orders payload from partner’s API. Need your expertise, help me to post this one JSON file over & over again to the API as input file.  below is the JSON body to be posted.  {    "app_id": "RDCSBY01"}