Quantcast
Channel: Attunity Integration Technology Forum
Viewing all 411 articles
Browse latest View live

Attunity Replicate express UI issues

$
0
0
Hi,

I recently downloaded and installed Attunity replicate express.
The service is up and running on Ubuntu 14. However, when I try
to log into the UI console I get the below error. Please advise.

This site can’t provide a secure connection

35.190.170.179 doesn't adhere to security standards.
ERR_SSL_SERVER_CERT_BAD_FORMAT

Manual Setting Of Oracle Supplemental Logging

$
0
0
If you do not want to let Replicate automaticly set supplemental logging then here are your options:

One option is to run the following on the database level:

ALTER DATABASE ADD SUPPLEMENTAL LOG DATA (PRIMARY KEY, UNIQUE) COLUMNS;

And the following for every table that has manipulation, filter on columns that are not part of the PK, or tables that do not have a primary key.

ALTER TABLE XXX ADD SUPPLEMENTAL LOG DATA (ALL) COLUMNS;

The other option is to run the following on the database level:

ALTER DATABASE ADD SUPPLEMENTAL LOG DATA

And then for every table:


  • If the table has a primary key:



ALTER TABLE xxx ADD SUPPLEMENTAL LOG DATA (PRIMARY KEY) COLUMNS



  • If the table doesn’t have a primary key and have a unique index:



ALTER TABLE xxx ADD SUPPLEMENTAL LOG GROUP (first unique index columns) ALWAYS



  • If the table doesn’t have a primary key or a unique index or if it has a manipulation or a filter defined on columns that are not part of the PK:



ALTER TABLE xxx ADD SUPPLEMENTAL LOG DATA (ALL) COLUMNS

How to write regular expression in attunityreplicate in column filed

$
0
0
How to write regular expression in attunityreplicate in column filed such as to

for 0[0-9]/[0-9]/[0-9] or 0[0-9]/[0-9] then send value

If There Is Null Value In Table, Wont It Be Replicated? Ms Sql To Redshift

$
0
0
If there is null value in table, wont it be replicated? from ms sql server to redshift.
using attunity cloudbeam replicate for amazon redshift

How to use Mutiple table in source_lookup

$
0
0
How can i add mutiple table name in source_lookup in TBL argument ?
source_lookup(TTL,SCHM,TBL,EXP,COND,COND_PARAMS)

Getting error GEN-E-MESSAGE

$
0
0
hi,
i am getting below error while performing CDC


00003052: 2018-05-04T08:34:54:128618 [SOURCE_CAPTURE ]V: Going to add Redo Log to LogMiner session (oracdc_reader.c:653)
00003052: 2018-05-04T08:34:54:128618 [SOURCE_CAPTURE ]T: Failed to add the REDO sequence '98830' to LogMiner in thread '1' (oracdc_reader.c:656)
00003052: 2018-05-04T08:34:54:128618 [SOURCE_CAPTURE ]T: Failed to set position in thread '1' (oracdc_reader.c:2038)
00003052: 2018-05-04T08:34:54:128618 [SOURCE_CAPTURE ]V: Going to execute the statement 'select status from v$thread where thread#= :thread' for thread '1' (oracdc_merger.c:74)
00003052: 2018-05-04T08:34:54:144248 [SOURCE_CAPTURE ]T: Oracle CDC stopped [1022301] (oracdc_merger.c:1056)
00003052: 2018-05-04T08:34:54:144248 [SOURCE_CAPTURE ]E: Oracle CDC stopped [1022301] (oracdc_merger.c:1056)
00003052: 2018-05-04T08:34:54:159869 [SOURCE_CAPTURE ]T: Error executing source loop [1022301] (streamcomponent.c:1564)
00003052: 2018-05-04T08:34:54:159869 [SOURCE_CAPTURE ]T: Stream component 'st_0_DBNAME' terminated [1022301] (subtask.c:1513)
00003052: 2018-05-04T08:34:54:159869 [SOURCE_CAPTURE ]T: Free component st_0_DBNAME (oracle_endpoint.c:49)
00008464: 2018-05-04T08:34:54:159869 [TASK_MANAGER ]E: Task error notification received from subtask 0, thread 0 [1022301] (replicationtask.c:2272)
00008464: 2018-05-04T08:34:54:159869 [TASK_MANAGER ]W: Task 'DBNAME' encountered a fatal error (repository.c:4773)
00007644: 2018-05-04T08:34:54:175493 [SORTER ]I: Final saved task state. Stream position 00000DEB3F0DDA790100000100017F580000CDFF0010000000 000DEB3F0D7FEC, Source id 1439061, next Target id 6673, confirmed Target id 6669 (sorter.c:652)
00006512: 2018-05-04T08:34:54:175493 [SOURCE_CAPTURE ]T: Free component Utility Source (oracle_endpoint.c:49)
00003052: 2018-05-04T08:34:54:159869 [SOURCE_CAPTURE ]E: Error executing source loop [1022301] (streamcomponent.c:1564)
00003052: 2018-05-04T08:34:54:159869 [TASK_MANAGER ]E: Stream component failed at subtask 0, component st_0_DBNAME [1022301] (subtask.c:1350)
00003052: 2018-05-04T08:34:54:159869 [SOURCE_CAPTURE ]E: Stream component 'st_0_DBNAME' terminated [1022301] (subtask.c:1513)
00007612: 2018-05-04T08:34:56:753656 [SERVER ]E: GEN-E-MESSAGE, Unexpected EOF detected: requested to read 16 bytes, actually read 0 bytes [1020601] (ar_net.c:734)

Teradata Connection Manager Editor - Error Unable to find the Driver

$
0
0
Hi All,
Need help resolving the following issue, Teradata Connection Manager is not able to Ping Teradata Server.
But I was able to use the same Server using ADO .net and other ODBC connectors.

Can you please let me know , in what location does it look for the driver.
So, based on this I should be able to fix the problem.


Server: Windows 2008 R2
Attunity Driver v1.2 for Oracle and Teradata
Visual Studio 2008
Teradata Driver 16.20 installed (both 32 bit and 64 bit )







TITLE: Microsoft Visual Studio
------------------------------
Error at PremiseExport [Connection manager "Teradata Connector"]: Failed to establish an ODBC connection with the database server. Verify that the Teradata ODBC Driver for Windows x86 is installed properly. SqlState = IM002 Message = [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specified


------------------------------
ADDITIONAL INFORMATION:


Test connection failed
------------------------------


Error HRESULT E_FAIL has been returned from a call to a COM component. (Microsoft.SqlServer.DTSRuntimeWrap)
------------------------------


Error HRESULT E_FAIL has been returned from a call to a COM component. (Microsoft.SqlServer.DTSRuntimeWrap)
------------------------------
BUTTONS:
OK
------------------------------


Thanks,
Senthil K

Daily delta load instead of near real-time

$
0
0
Hey Everyone,

We have an unfortunate business need preventing us from using Attunity replicate to our Greenplum data warehouse the way we would like. Essentially we are limited to only loading data once a day instead of allowing near-real time replication.

Now our pre-production environment in a more simplified explanation is replicating from a Sybase ASE source to a File Channel and from the File Channel to another Sybase ASE environment and a GreenPlum data warehouse. The Sybase ASE target will be near real-time replication, but the Greenplum target will be loaded once a day, by starting the task from the File Channel to the Greenplum target until it reaches transactional consistency then stopping it.

Our concern right now is that performance isn't going to be acceptable during this one time load, roughly 1-5 million rows depending on the day. I am seeing very high ram utilization (32GB) causing the tasks to fail, then restart. Eventually most of the data does make it's way through, except in the test I am running now around 6500 transactions never make there way into the target and appear stuck in "Applying until target commit".

Has anyone tried something like this before? Any advice? I have tried using transactional apply and batch apply without very much luck. I don't have a ton of knowledge on the internal workings to know if we are in some serious trouble, such as if it is going to try and load a days worth of transactions into ram at once.

The long term objective (phase 4 unfortunately) is to replicate to a second live schema with the change data capture tables enabled and have an etl job run once a day to update a secondary schema in order to provide a route for the business away from the daily load methodology. Due to time constraints on the business objectives however this won't be doable currently.

Any help would be greatly appreciated. Thank you!

MySQL to Hadoop/Oracle CDC - Source character set not supported by Client

$
0
0
We have requested for Attunity Replicate Trail/Free Version tool to analyze/compare the capabilities of Attunity CDC Tool.

We are using MySQL as Source and Oracle/Hadoop as Target.

We have successfully able to create different source and target for Manage Endpoint Connections. Successfully able to create Task using those source and targets. But while running the task getting below exceptions -


00005680: 2018-05-23T05:47:26 [SERVER ]I: Task Server Log - ReplicateMySQL (V5.0.2.58 xxxxxxx Microsoft Windows 64-bit, PID: 1884) started at Wed May 23 05:47:26 2018 (logger.c:475)
00005680: 2018-05-23T05:47:26 [SERVER ]I: Licensed to Attunity Replicate Express users (software license acceptance implied)Express license: You are running the Express Edition with reduced functionality (296 days remaining) (logger.c:478)
00005680: 2018-05-23T05:47:26 [SERVER ]I: Client session (ID 18977) allocated (dispatcher.c:241)
00005680: 2018-05-23T05:47:26 [TABLES_MANAGER ]I: Task 'ReplicateMySQL' running full load and CDC in resume mode after recoverable error, retry #63 (replicationtask.c:900)
00005680: 2018-05-23T05:47:26 [METADATA_MANAGER]I: ODBC additional properties = 'GET_SERVER_PUBLIC_KEY=1' (mysql_endpoint_imp.c:562)
00005680: 2018-05-23T05:47:26 [METADATA_MANAGER]I: Connecting to MySQL through ODBC connection string: DRIVER={MySQL ODBC 5.2 Unicode Driver};SERVER=localhost;port=3306;UID=xxxx;PWD=** **;DB=;Option=74448896;GET_SERVER_PUBLIC_KEY=1 (mysql_endpoint_imp.c:646)
00005680: 2018-05-23T05:47:26 [METADATA_MANAGER]I: Going to connect to Oracle server CDB12C with username xxxx (oracle_endpoint_imp.c:828)
00005680: 2018-05-23T05:47:27 [UTILITIES ]I: The state is restored from file 'C:\Program Files\Attunity\Replicate\data\tasks\ReplicateMySQL/StateManager/ars_saved_state_000002.sts' saved at Wed, 23 May 2018 09:41:52 GMT (1527068512396752) (statemanager.c:1065)
00001912: 2018-05-23T05:47:27 [TASK_MANAGER ]I: Creating threads for all components (replicationtask.c:1390)
00001912: 2018-05-23T05:47:27 [METADATA_MANAGER]E: RetCode: SQL_ERROR SqlState: 07006 NativeError: 0 Message: [MySQL][ODBC 5.2(w) Driver][mysqld-8.0.11]Source character set not supported by client [122502] ODBC general error. (ar_odbc_stmt.c:2814)
00001912: 2018-05-23T05:47:27 [METADATA_MANAGER]E: Error in captured tables list query: select TABLE_SCHEMA,TABLE_NAME from INFORMATION_SCHEMA.TABLES where TABLE_TYPE='BASE TABLE' AND(
( /* Explicit */
(TABLE_SCHEMA='emp' and TABLE_NAME='persons1' )
) OR ( /* Inc patters */
(1=0)
)
)AND NOT ( /* Exc patterns */
(TABLE_SCHEMA like '%' and TABLE_NAME like 'attrep_changes%' or TABLE_SCHEMA like '%' and TABLE_NAME like 'attrep_apply%' or TABLE_SCHEMA like '%' and TABLE_NAME like 'attrep_truncation%' or TABLE_SCHEMA like '%' and TABLE_NAME like 'attrep_audit_table' or TABLE_SCHEMA like '%' and TABLE_NAME like 'attrep_status' or TABLE_SCHEMA like '%' and TABLE_NAME like 'attrep_suspended_tables' or TABLE_SCHEMA like '%' and TABLE_NAME like 'attrep_history' )
) ORDER BY 1,2 LIMIT 60000; [122511] Query setup error (mysql_endpoint_imp.c:1867)
00001912: 2018-05-23T05:47:27 [METADATA_MANAGER]E: Failed to get the capture list from the endpoint [122511] Query setup error (metadatamanager.c:2910)
00001912: 2018-05-23T05:47:27 [TABLES_MANAGER ]E: Cannot get captured tables list [122511] Query setup error (tasktablesmanager.c:870)
00001912: 2018-05-23T05:47:27 [TASK_MANAGER ]E: Build tables list failed [122511] Query setup error (replicationtask.c:1494)
00001912: 2018-05-23T05:47:27 [TASK_MANAGER ]E: Task 'ReplicateMySQL' failed [122511] Query setup error (replicationtask.c:2348)
00001912: 2018-05-23T05:47:27 [TASK_MANAGER ]I: Task 'ReplicateMySQL' encountered a recoverable error (repository.c:4411)
00001912: 2018-05-23T05:47:27 [UTILITIES ]I: The last state is saved to file 'C:\Program Files\Attunity\Replicate\data\ta


Environment Details –

Operating System – Windows Server 2012 R2 Standard
MySQL - 8.0.11.0
ODBC Connector – 5.2 Unicode Driver
MySQL Schema Table Details – emp.persons1

Name:  odbc.png
Views: 10
Size:  14.2 KB
Attached Images
 

Run Sql query after full load finished

$
0
0
Hi,

We are replicating data from DB2 to Oracle.Our version is 6.1.

What I need that;

I need to run a script after full load finish.

Is it possible?

Best regards.

Necati.

Error loading library when trying to create kafka endpoint

$
0
0
Im trying to create a kafka endpoint. When I test connection im getting an error:

'Error loading library 'libarepqueue.so' [20019] DSO load failed Details'.


Has anyone come across this?

Oracle to MSSQL Temporal Table

$
0
0
I am trying to replicate from Oracle into a temporal table on SQL-Server. The target would then provide a history of the changes made in the source table, especially updates and some deletes.


A temporal table requires some technical attributes. These do not exist in the source table. Attunity seems to fill-in a NULL value/placeholder for every attribute that isn't provided by the source mapping.

Code:

create table customerStage (
id int constraint PK_customerStage primary key,
startDT datetime2 generated always as row start not null,
endDT datetime2 generated always as row end not null,
period for system_time (startDT, endDT),
someData varchar(50)
)
with
(
system_versioning = on (history_table = dbo.customerStageHistory)
)

To use this kind of tables, we need a way to have attunity ignoring these attributes (startDT, endDT, period) in the internal commands (bcp).

Otherwise the task fails reporting that we cannot insert a NULL value into those fields.


As a work-around, I replicate data from oracle into a "normal" table on SQL-Server. This table fires triggers to promote the operations to the actual temporal table.

The Change Files location cannot be found.

$
0
0
Hi,

i'm new to using attunity and i am playing around with file as a source.

i'm currently getting this error

The data file(s) location '<path>' cannot be found. [1020401] (file_imp.c:4814)

AR "engine" is in linux and AR console is in windows.

question is, when setting up the file as source, the path should i be using is from the windows console or linux server?

Thanks!

Issue with Oracle DB Source (in Cloud)

$
0
0
Hi,

I am trying to replicate our ERP system database (Oracle 12C - Multitenant environment (PDB) and hosted in Oracle Cloud)

Since LogMiner does not support PDB I am trying to use the "Binary Reader" in Attunity Replicate Express".

I have succeeded in doing a full load, but I cannot capture any changes (have trying several update/commit statements on source, but nothing is applied on the destination (SQL))

I can see in the console that whenever I do a update statement it is registered in the "Incoming Changes" bar: (0 Transactions) changes to (1 Transactions)

However when I then do a commit on source it changes from (1 transactions) to (0 transactions) but the change never appears on the destination :-/

The "only" errors I can see is:
00006404: 2018-06-06T10:24:41 [SERVER ]E: Failed to create a process mutex 'Local\ATTUNITY_AR_METRICS': Access is denied. [120106] A call to a system function has failed. (syswindows.c:190)

00004768: 2018-06-06T10:24:42 [METADATA_MANAGER]W: Table 'CRPDTA.F0006' cannot be captured because Oracle Security DB Encryption value was not provided (oracle_endpoint_lists.c:868)

I don't really have a clue on what they mean and what a possible solution can be.

All help is appreciated!!!

Attunity Replicate - Table Filter - Last 6 months

$
0
0
Hi,
I am trying to filter my source table (SQL Server).
I wish to include records created in last month.
My Record Selection Condition is as follows:
$DateCreated>datetime('now','+1 MONTH')

It parses fine in the the Expression Builder, but using SQL Server Profiler I can see that the condition does not appear in the record selection query, and all of the rows in the table are ending up in my target table.

My source table column name is DateCreated which has datetime data type.

SSIS with Kerberos

$
0
0
Hi all,
we plan to run our SSIS packages under Windows integrated security. I made it working for OLEDB and ODBC connection managers, but I struggle to do the same with Attunity connection managers.
Situation is like this:
  • we have an Active directory account SomeDomain\SomeWindowsAccount
  • on Oracle side we have defined some proxies (I do not understand much Oracle), so the SomeDomain\SomeWindowsAccount can act as SomeOracleAccount.
  • with SQLplus and OLEDB/ODBC connection managers, I can successfully connect to ORACLE as SomeOracleAccount when running the package as SomeDomain\SomeWindowsAccount (square brackets in user name make the trick - [SomeOracleAccount]).
    Code:

    SELECT user FROM dual;
    returns SomeOracleAccount, which is what I need.
  • I'm having hard time to achieve something like this with Attunity connection manager. I can connect using Windows authentication, but
    Code:

    SELECT user FROM dual
    returns SomeWindowsAccount (do not know how to craft the connection string to be able to login as SomeOracleAccount).

Thanks for any help!
Petr

Version Support Matrix

$
0
0
Hello,
I am trying to find out which Oracle Database Versions are supported by Attunity. Haven't found a quick info page yet.

In particular:
Oracle 12.2.0.1.180116

Attunity: 6.0.0.243 (Web GUI)

Thanks,
Roger

AWS Attunity Replicate Hourly - **NO KAFKA TARGET LICENSE

$
0
0
Hi,

I'm trying to use Attunity Replicate to get data from Oracle sources and delivery these data to a Kafka target.

Our Attunity instance is running through an AWS Marketplace - Attunity Replicate Hourly license

When we try to execute an integration task the following error occurs: “Task cannot be started because target database [target name] of type ‘Kafka’ has no license”.

Do I have to do any proceed in order to activate this type of target, or AWS Marketplace - Attunity Replicate Hourly really doesn´t have support to Kafka targets?


Thanks in advance,

Jean

Data Science Technology

$
0
0
Hey Peers,

I am looking into data science technology. I wanted to know how much SQL role is there for Data science learning. Please suggest me..!!

Access Denied using RepliWeb R-1/RDM

$
0
0
Would you be able to provide any deployment documentation for Attunity RepliWeb R-1 6.2.068.150216 (x64) & RepliWeb Drive Mapper (RDM) v2.2 (x64)?

We’re currently troubleshooting technical difficulties with your application. Within our network we’re seeing Access Denied errors when attempting to connect a R-1 center’s file upload job to a RDM referenced UNC share.
RDM can connect to the target UNC share without error, returning “Drive is properly mapped” status. But when we attempt to use the mapped drive to kick off an upload job it fails with “Access Denied”.
Other jobs are running without issue from this same R-1 Center to other RDM resources without error.


Any details you can provide would be appreciated,

-Jason
Viewing all 411 articles
Browse latest View live