Solved

Hello CDATA Community,I hope this message finds you well. I am currently facing an issue with the CDATA Sync tool and would appreciate any insights or assistance from the community.Problem Description: I have configured a job with a single task, where the source is Salesforce, and the destination is an SQL database. Initially, I ran the task without incremental replication, and it successfully synchronized all records for a specific Salesforce object. Later, I implemented incremental replication and verified that it worked as expected. However, when I decided to remove incremental replication and attempted to sync the data again, the job seems to persist in using incremental replication, and not all data is being synchronized. Steps Performed:Created a job with Salesforce as the source and SQL database as the destination. Ran the task without incremental replication, successfully syncing all records. Implemented incremental replication and verified its functionality. Removed incrementa

I’m getting the following exception when trying to run the following code.  Does the driver support the Trino JSON type?  I don’t see json referenced in GetResultTypeData method source.string sql = "SELECT _id, CAST(extra_columns AS JSON) as extra_columns FROM hive.default.measures";PrestoCommand cmd = new PrestoCommand(sql, connection);PrestoDataReader rdr = cmd.ExecuteReader();  Message: Test method Juniper.Test.Trino.TrinoClientTests.PrestoAdoRead threw exception: System.Data.CData.Presto.PrestoException: [500] Could not execute the specified command: Unknown datatype: JSON. ---> oro230j.TC: Unknown datatype: JSON. Stack Trace: ZN.GetResultDataType(FormulaEvaluationContext )RqC.K(SqlFormulaColumn )RqC.mI(SqlTable , SqlColumn )Rod.C(SqlCollection`1 )Rod.Nd(LLB`2 )Roh.Nd(LLB`2 )KJ.U(SQLQuery , Int32 , RRq )KJ.d(IDataStatement , SQLQuery , QueryParameterCollection , Int32 , String , LeW )RUJ.ExecuteQuery(IDataStatement , QueryParameterCollection , Int32 )RUG.ExecuteQuery(IDataStat

I’m getting the following exception when trying to run the following code.Is there a way to enable or set the HTTP Header X-Trino-User?PrestoConnection connection = new PrestoConnection($"Server={_configuration["TrinoServerIP"]};Port={_configuration["TrinoServerPort"]};");connection.Open();string sql = "SELECT * FROM hive.default.customer";PrestoCommand cmd = new PrestoCommand(sql, connection);PrestoDataReader rdr = cmd.ExecuteReader();while (rdr.Read()){ Console.WriteLine(String.Format("\t{0} --> \t\t{1}", rdr["Id"], rdr["Name"]));} PrestoAdo  Source: TrinoClientTests.cs line 91  Duration: 1.4 sec Message: Test method Juniper.Test.Trino.TrinoClientTests.PrestoAdo threw exception: System.Data.CData.Presto.PrestoException: [500] Could not execute the specified command: HTTP protocol error. 401 Basic authentication or X-Trino-User must be sent. ---> oro230j.TC: HTTP protocol error. 401 Basic authentication or X-Trino-User must be sent. Stack Trace: LdJ.j(Lax[] , Int32 , Int3

We have a lot of manufacturers that we send X12 850 purchase orders to.  We don’t always receive a 997 and I am wondering if its possible to read and parse the MDN and extract the response confirming delivery.My goal is to confirm AS2 delivery and add an Email send connector to the flow and notify our purchasing department that the PO was received. Thanks

Hi all,We are migrating from on-prem tabular models to PowerBI Premium models. Most datasources work flawlessly (including the CDATA Snowflake connector). However, we have been unable to use another tabular model as a data source when using PowerBI Premium models…We have the same problem when trying to connect to our Power BI Premium models from our data catalog (Ataccama). OLD On-prem Visual Studio source:Friendly connection name: [model name]Server or File Name: [server] \ [Folder]Database name: [Database name]OLD Ataccama /CDATA JDBC connector:jdbc:cdata:ssas:User=[user];catalog="[catalog]";URL=http://[server]/OLAP/msmdpump.dllNew Connections that work:Excel Connection (Power BI Premium Data Source):Provider=MSOLAP.8;Integrated Security=[];Persist Security Info=[];Initial Catalog=sobe_wowvirtualserver-[GUID];Data Source=pbiazure://api.powerbi.com;MDX Compatibility=1;Safety Options=2;MDX Missing Member Mode=Error;Identity Provider=https://login.microsoftonline.com/common, https://ana

Does anyone have a Data Model (Star Schema ideally) visual they can share for new users to WorkDay intending to use PowerBI with the adapter?

When bulk loading to Snowflake, data is uploaded to a temp table (named by CData) and then insert/merged into the final target table.Is there a way to specify, either at the Connection level, or the Job level, what Database or Schema should be used to store those tables?  By default it just puts them in the target schema, but it would be nice to split those out so we can more quickly clean anything up after an aborted job.

I now use CdataSync to transfer ActianZen database data to Bigquery through Btrieve Connector.1. Even after the data transfer is completed, if you view it in ActianZen's Monitor, it still exists in ActiveFile, that is to say, the resources have not been released.2. The open mode of the file whose resources have not been released is not the readonly mode, but the normal mode.Because of the above problems, table lock occurs on the system operation page using the ActianZen database.If you know how to solve it, or how I should try to solve it, please tell me, thank you very much.

is it possible for us to configure CData Sync to use more RAM of the VM? For example, when I do a initial replication of 1mil records from Redshift (RA3.16xlarge) to Snowflake (medium wh).. it takes roughly 3 mins.. I noticed Cdata is using only ¼ of the total 32GB RAM available. 

Hello,When creating temp files to be bulk loaded up to Snowflake, CData Sync appears to be creating the files in this folder on our Windows server:file://C:\\Windows\\SERVIC~1\\NETWOR~1\\AppData\\Local\\Temp\\*Is there a way to direct CData to use a different folder, globally, for all temporary workspace?Thank you!

Hi Everyone,I have a scenario to use Azure Managed SQL Instances and these are not supported for DBAmp because they do not allow the installation of 3rd-party linked servers on the Instance. So I am trying to install dbamp remotely - DBAmp - Running DBAmp Remotely (cdata.com)Client have created 2 servers one where data will be stored - dbSeverTwo where dbamp will be configured as linked server - dbampServerData Scenario - Data will be storing in Ddrive so I am using SSIS to push the data into SQL server I have created package and deploying that package to both dbserver and dbamp ServerSo my question is in the article it says to create remote database  “Salesforce Backups” in remote server instance to hold the salesforce data but can’t we store the same data in dbamp server? Is there any security concern or limitation if we store Salesforce data in dbamp server? 

Hi,We have a client who is interested in using the new Salesforce custom address fields. (https://help.salesforce.com/s/articleView?id=sf.fields_caf_requirements.htm&type=5) . Because it looks like data can only be imported using Bulk Api 2.0 does anyone know if DBAmp can support import into these new fields? Thanks!Eve

Why DBAmp V22 SF_MirrorAll takes much more time (couple hours) than V5.1.9 SF_RefreshAll? even I skipped many tables, like %History, %Share... Also there are many error messages: Error occurred creating primary key for table.

Hello,Has anyone experimented with different batch sizes while sending data into Snowflake?  It looks like the default is 100000 rows.  I am wondering if there are any downsides to trying a higher number.Thanks!

I have following script: <arc:set attr="Files#1">[FilePath]</arc:set><arc:call op="xmlDOMSearch?uri=[FilePath]&xpath=/Items/File"> <arc:set attr="Files#[_index | add(1)]">SOME_FILEPATH\[xpath('FileName')]</arc:set></arc:call><arc:enum attr="archiveFiles" expand="true"> <arc:set attr="_log.info">([_index]) [_attr] -> [_value]</arc:set></arc:enum> Whatever I try, the enumeration only shows the first item.  If I add a arc:set="_log.info” in the arc:call, each item is logged, but for some reason it is not added in the array. The reason I want to add these files in an array is that I want to compress them all in 1 ZIP file.

The inquiry is as outlined in the title: I am looking to establish a setup enabling the modification of dashboards and lenses within CRM Analytics directly from an Excel worksheet, ideally facilitating a live two-way connection. If this solution is exclusive to Tableau, I will continue my search. Any recommendations on alternative solutions or platforms to explore would be greatly appreciated!

I have a dilemma of sharing Snowflake data with several on-prem SQL server. The question is if I should use CData to replicate data by batch from Snowflake to SQL server, or if I can create a Linked Server using CData driver to avoid data movement.I understand there would be performance implications of each approach. However, I am curious to hear your thoughts. Thanks,Ming

I was wondering if anyone had a good solution for purging files from all flow connectors.  Maybe a custom script where I could pass in WorkspaceId and a ConnectorId that would delete files from the Send/Receive directories.My initial thought, is it possible to delete files across all connectors within any given flow?I have a few CSV connectors that are used to download 5K+ rows, split them into their own file and pass the data into a SQL stored procedure.Because of the split, that single CSV is now a new XML file for each line.  As it travels down the flow I end up with 5K+ XML files in my Send/Receive directories.  Usually I get an Arc notification that the size of X directory has exceeded the recommended size..Right now, I use the interface to click Delete All from both Input/Output tabs to keep folders clean. 

I don’t know if this is possible but I have a standard 850 map that I am able to use with all of our trading partners.  I am using the SQL connector to return the data of a simple Header/Detail table relationship.  Up until now, the data from the Detail table has always been sufficient for all of our current connections, but I have a new connection i’m setting up and they require additional data.Currently, I am creating POLoop1 > PO1and sending the following:PO101 linenumberPO102 QuantityPO103 Identifier (EA)PO104 PricePO105 (empty)PO106 Identifier (N4)PO107 UniqueIDThis new setup requires PID (which I have added) but they only need PID05 (item description).My question is: Is is possible to add some arc script within my loop where I can call a SQL stored proc and pass it the value of PO107 and map the result to PID05?Thanks

Hey guys, I´ve facing an error with this MongoDB component.When I´m trying to setup my data flow at SSIS, I´m facing an error warning that the view that I´ve setup doesn´t exist look to screen shot below:The problem is not in my connection manager, because I can use the same process with an other collection, for example, any view I set, this error appear, Have anyone else seen this before?

When using the Python connector in conjunction with SQLAlchemy, we introduced a new dialect with the "_2" suffix to accommodate SQLAlchemy 2.0. For instance, the QB Python connector features a dialect named "quickbooks_2."Previously, we utilized automap_base in the following manner:engine = create_engine("quickbooks:///?<connection string>")However, if the customer wishes to employ SQLAlchemy 2.0 and prevent potential errors when using automap_base, the following code should be used:engine = create_engine("quickbooks_2:///?<connection string>")

Just received an error on the Input of my AS2:The Message Integrity Check returned by the server is incorrect. Expected: iPPnthXZ7ofwn1v8b6lzhhPhE+2ZYHp+aHDfRgJsI8c=; Received : hrROR/jpYl1Q7PKbG2tY4AHImdCALRS37NPEDiH+5go=This is the first time I’ve seen this error.  What I don’t know is - is this on my side or the trading partner?Anyone familiar?Thanks.

Hi guys, I cannot get the companies and deals table to execute in the data ingestion phase. Anyone has experienced this before? The error I keep getting is:Executing table [HubSpot].[Companies]:failed with error:System.Data.SqlClient.SqlException (0x80131904): Execution Timeout Expired.  The timeout period elapsed prior to completion of the operation or the server is not responding. ---> System.ComponentModel.Win32Exception (0x80004005): The wait operation timed out 

I am using the 2023 xBase driver in dBeaver, and receiving this error:SQL Error [HY000]: ORDER BY is mandated in the OVER clause for the function row_number. The Query is:select distinct       'BNK' swityp,       cast(c.cbank_acct as varchar) oldkey,       row_number () over (order by g.cid) newkey,       '' del,       g.cgroup_cod,       g.acct_no,       g.acct_descr,       g.active,       g.cidfrom checkreg cjoin glacct g on g.cid = c.cbank_acctorder by g.cid As you can see I have an ORDER BY in the OVER clause. BTW, changing it to upper case has no effect. What am I missing? Does xBase only partially support row_number? Is there any documentation on the xBase driver and which syntax it supports?

Hello, couple of CSV source related questions…How do I indicate, for a CSV-based source is, what the primary key column is for each table, so that an upsert can be properly done?   Is it possible to move the files to another folder (in the operating system) after Sync has ingested them?  We would want to archive the files so they don’t get re-processed the next time.  I can do this outside of Sync if necessary, but it would be cleaner if Sync could do this somehow (or call out to a batch file on the OS and run that).   In my case, I have many source files with a timestamp, like MYFILE_XYZ_20231006.TXT.  I would like to use the file Aggregation so that I can just pull them all into the same target table.  However when I do that, is there a way to pass along the individual filename being processed, into a column in the target table?Thank you for any assistance you can provide!