Data Integration

I need to generate a CSV file with a header and trailer record, not column headers.  What is the best way to accomplish this?

hi, Dear Team, I am in the process of setting up an AS2 link between us and our partner but my partner cannot send us the message. For our part, sending messages to the partner works well but it is impossible to receive their messages.I have no logs on ArcESB and my partner thinks that the problem comes from us.We have traffic on our partner's port but we have an error like: 'RST,ACK'Looks like the partner is rejected.On the partner’log :disconnection indication         [reason="Error 0 (0x0)"] [origin="0"].My partner can do a telnet our AS2 server successful. Could you help me please Best Regards,BL

I've set up a flow that interacts with other services using the REST connector. From this flow I've created a Flow API by multi selecting the entire flow, right clicking it and selecting the API settings option. Inside the flow I extract a response header from one of the REST requests respones I receive in the flow and I want that value to show up as an output header of the entire Flow API response whenever this service gets called from the outside. Right now I only can see the default response headers. I've read and search the documentation pertinent to these elements but I haven't found out how I can create and parse custom response headers for the Flow API and if anyone knows how to do that, your help will be immensely appreciated 😬

I have Workspaces A, B and SWorkspace S (for ‘shared’) is a sort of utility or library workspace.My plan is for Workspaces A & B to set a message header e.g. _message.header:callingFlow in Event:BeforeSend and then use WorkspaceSend to call the WorkspaceReceive in S. S then needs to respond back to the correct calling Workspace.Can a WorkspaceSend in S dynamically call WorkspaceReceive in A or B based on  _message.header:callingFlow ?Or do I need use maintain a series of Branches (we could have many more calling workspaces in the future)

Trying to bring JIRA data onto snowflake using CData. All the tables loaded successfully except Worklog. The worklog table failed with below error. [0] [500] Could not execute the specified command: Failed to cache row [3652696] Invalid HTTP response! Timeout.. StackTrace: at aso230l.nT.Next() at aso230l.mH.Next() at aso230l.mb.Next() at aso230l.mY.Next() at aso230l.mQ.Next() at aso230l.Kz.q(DbCommand , DataTable , IResultSet , ColumnInfo[] , Int32[] , jsb ) Any help on this topic is greatly appreciated.

Hi,I have been trying to migrate data from cassandra to mysql..The size of the source data table is approx. 4.5 GB.The migration job ran for 11 hours and then failed with below error:2024-01-24T22:13:40.908+0530    1    [2|Q-Id]    [SQL |Cache ] The operation timed out.2024-01-24T22:13:40.955+0530    1    [2|Q-Id]    [SQL |Cache ] Cache failed: The operation timed out.2024-01-24T22:13:40.955+0530    0    [2|Q-Id]    [SQL |Cache ] Replication Failed. Error:The operation timed out.2024-01-24T22:13:40.955+0530    1    [2|Q-Id]    [RealDB:cdata.jdbc.cassandra.CassandraDriver]The connection is disconnected.2024-01-24T22:13:40.955+0530    1    [2|Q-Id]    [RealDB:MySQL]The connection is disconnected.2024-01-24T22:13:40.955+0530    1    [2|Q-Id]    [RealDB:Derby]The connection is disconnected.2024-01-24T22:13:40.955+0530    1    [2|Q-Id]    [SQL |Messag] Query Failed: [REPLICATE [orderdashboard] WITH _id = 'dVliqUz79KW/pJr8i

Hi!I am working with a client who uses NetSuite ERP. We are trying to get Sales reports for them, which we are doing by using the transaction table from SuiteQL schema.We also need the transactions’ status, for which we need the transactionStatus table to load through Sync. On doing so, I am getting the following error :“[0] [INVALID_PARAMETER] Invalid search query. Detailed unprocessed description follows. Search error occurred: Record 'transactionStatus' was not found. Bad Request.” Please help me load this table.​​​​​​​

I'm using an xmlmap connector to create an insert into a slq table. everything works correctly, I recently had to add a field for each record I insert that must contain the name of the file I'm importing (which is the same name as the output mapping xml file for the slq connector)There is no way I can create the mapping via the script. I searched for examples and other topics, I use this simple command <arc:set attr="result.text">[Filename]</arc:set>The error in the log i have is:The value of the attribute could not be accessed: The attribute does not exist.I have no indication of the reason and I have already made many attempts, any suggestion or idea is welcome, thanks in advance for any help you wish to give me.Best Regards.

Hello,I need to get a specific filename part value while mapping XML to the desired structure in the XMLMap connector. F. ex. I need to extract ‘1234’ part from a file name 1234_abcd.xml.I have tried to write an expression in the Expression Editor: [getfilename(substring(0, indexof(filename(), "_")))]It does not work and I am not sure that is wrong.Any ideas? Maybe there are even better solutions?

Is there a way to export the message or transaction logs from /logs.rst#messages or logs.rst#transactions ?I want to analyse traffic so I can determine a maintenance window for the best time do upgrade cData Arc I’m sure with a bit of AI magic cData Arc could even suggest one 😃 

🚀 Exciting News from the DBAmp Team! The CData DBAmp Winter 2024 Release is here, bringing groundbreaking enhancements to your experience!  🔍 What's New?  Significantly improved OpenQuery Performance: We've optimized the TDS daemon process, ensuring a 50% boost in efficiency for OpenQuery operations! 📈  Refined internal operations: With smarter processing of SMP request packets and timely SMP scheduling thread notifications, say goodbye to waiting times. ⏱️  Enhanced system alignment: The execution times in SSMS are now closely synced with the Salesforce driver method. 🔄  💡 Why This Matters?  Experience unparalleled efficiency and reliability with CData DBAmp.   Our commitment to quality and customer satisfaction shines through in every update.   👉 Don't miss out on the latest advancements that CData DBAmp has to offer. Download the newest version and take adv

Greetings everyone.I have a problem using a flat file connector, which I use to convert a fixed length .txt file to xml. the conversion is successful, but the characters present that have accents are converted with the symbol � in the resulting xml. Are there any settings or workarounds to avoid this?address in the .txt file → 3 AVENUE DES SPÉLUGUESaddress in the xml file → 3 AVENUE DES SP�LUGUESThanks in advance to anyone who can help me

Dear All, I have a business logic, where i need to select value for RSN field , based on below Condition  IF  TypeCode = WriteOff  then   {       if  RsnCode = “1004” then          Rsn = “925”      elseif RsnCode = “1006” then         Rsn = “200”      elseif RsnCode = “1003” then         Rsn = “935”    }ElseIf TypeCode = WriteOn then  {       if  RsnCode = “1004” then          Rsn = “950”      elseif RsnCode = “1006” then         Rsn = “250”      elseif RsnCode = “1003” then         Rsn = “935”    } to achieve i tried to add the arc:case within the If condition as below,  <arc:if exp="'TypeCode'=='StockWriteOff'">  <arc:select attr="RSNCode">  <arc:case value="1006">    <arc:set attr="Rsn" value="200"/>  </arc:case>  <arc:select attr="RSNCode

As of the publishing of this entry, there is nothing inherent in ArcScript that performs the equivalent of a sleep or delay - all commands in ArcScript are executed immediately.  In most cases, it is desirable to execute scripting operations immediately, but there may be times when a sleep between calls would be useful (for example, when interspersing calls to an API that may be rate limited). In that situation, you can effectively create a delay in ArcScript through use of the sysExecute operation, which allows for the execution of external processes on the machine.  On a Windows environment, for example, you can call out to a batch file which itself implements the delay: <arc:set attr="sys.Name" value="C:\\ProgramData\\CData\\Arc\\Sleep_2s.bat" /><arc:call op="sysExecute" it

Hi I want to trigger a simple flow using a webhook. When I call it via PostmanPOST /connector/AtlasTrackingToServiceBus/Webhook1/webhook.rsb HTTP/1.1Host: jpREDACTED01:80XXContent-Type: application/xmlAuthorization: Basic RGF0-REDACTED-5eTFnContent-Length: 13<root></root>I’m not interested in the message body, I just want to trigger the flow I can see the Webhook being triggered and that looks SUCCESSful. The Webhook flows into a MySQL Connector, but the MySQl Connector reports that the message is not “Finalised” [2024-01-08T11:38:56.632] [Info] Ar

You can use post-job Events to run some arbitrary SQL (like a stored procedure) at the end of your Job.The documentation says you have to make your own connection, as below.  But I’d really rather not embed cleartext credentials in multiple jobs.  Is there a way to specify a CData connection (which we’ve already established at this point), in the Event?What I’d really like is the ability to run arbitrary SQL commands against the target table, after each Task completes, not just at the end of the Job.  Seems like this could be a parameter that we supply as we define each Task.<api:set attr="db.driver" value="System.Data.SqlClient"/> <api:set attr="db.conn" value="Data Source=sqlserver;Initial Catalog=Test;User ID=user;Password=pass;"/> <api:set attr="db.query">INSERT INTO MyLog (JobName, RunDate, Results) VALUES ('[_input.JobName]', '[null | now()]', '[_input.JobStatus]')</api:set>

Using CData Sync Cross Platform with Workday WQL connection. Some queries work successfully, but a bunch fail with this message:[0] Received error from Workday: Invalid WQL query: !**! This error occurred during a request to calculate the field !**!, for instance !**!.. Cause: com.workday.exceptions.ExternalFieldException: The Increment or Decrement Date field, !**!, has encountered a blank date..  Thanks.

Trying to connect to Min.io on-prem S3 bucket. Confirmed API is working:  However, I don’t know how to point to https://nas2.piorl.us:9000/bucket1/ in CDataSync Cross-Platform Edition. I’ve tried defining the full path in the Bucket field as well as “Path” in advanced options, but neither want to work. There is a reference to a “Custom URL” field in the advanced connection properties, but I can’t find the variable anywhere:  Thanks.

I am using the Copy connector to make a copy of all EDI 810 for a trading partner and sending them to another workspace where I need to find a group of 200 possible unique matches and route them to another trading partner.  As you can see in the screen shot below, I know what file name(s) to look for and therefore began this new flow using the Branch connector.  The values I’m looking for in the filename will always match a specific pattern.  However, the branch connector is going to be MASSIVE if I manually add 200 possible filename patterns. (this image shows only 6)Besides being tedious, this method will work but I am wondering is there a way to script this?  Regardless, I will still be hard-coding 200 filename prefixes.  Thanks

My lookup looks like this `/Items/tracking_events/parcel` node does not exist. Only /Items/tracking_events existsWhen I run the connector I don’t get a parcel or a barcode node.I have also tried /Items/tracking_events/parcel_barcode.Does the XML node have to exist in the incoming message? I can extract the barcode to a message header okay.

If we configure DBAmp to use a remote server (e.g. Azure managed SQL), does all data flow through the server where DBAmp is installed?  And if so, what is the transport-layer security between the DBAmp-server and the remote server?

Hi I have a complex MySQL query with several JOINs need to only fetch new data from the tables. I have read https://cdn.cdata.com/help/AZH/mft/Database-AC.html#only-process-new-or-changed-records but not sure how to apply this to a Custom Query, Can custom queries us data from the message header? If so I may be able to use the method James suggested at  

Hi, So I have a system with CDataSync to sync my data from SQL Server to Azure Synapse with below detail: Old System:CDataSync Version: 22.0.8342.0CData AzureSynapse Provider Version: 22.0.8326.0 New System:CDataSync Version: 23.3.8704.0CData AzureSynapse (23.0.8616.0) I backup the old configuration and restore it to new configuration. However, it keeps getting an error like this Error: The SQL Error Number is 103010, State is 1, Severity is 16, Error is 'Parse error at line: 1, column: 126: Incorrect syntax near '.'.', Server name is server1, Line number is 1. The Token Type is 170. I found that the task is successful when I use this conditions:I dont use a new scheme for the destination, but I checked the Drop Table/Truncate Table I use a new scheme, but I unchecked the Drop Table/Truncate TableIs there a new query or options that chan

I am setting up a new trading partner to send EDI X12 850 and they keep coming back to me saying “we received your file but it is not processed with octet-stream.  Please send as EDI-X12”.My X12 connector is setup and working just like the dozens of other trading partners.This is a screen shot of what they are sending me:I checked the Advanced settings on my X12 connector and didn’t see where the application/octet-stream is being set.  I tried adding payload=application/edi-x12 on my AS2 Extension map to no avail.Any ideas would be appreciated.

I’m attempting to add a task to an existing job and get an error:“The job <job-name> contains an unlicensed connection: Only 10 tasks are allowed in the Job” I also tried creating a job from this existing job and got an error:The connection [Salesforce_abc] is unlicensed: Unlicensed connections cannot be shared across multiple jobs. We have an Enterprise license, and my job is using SalesForce as a source and Azure SQL as a destination. I tried adding a task to a different job that uses Salesforce as source and Azure SQL as destination, and it worked.