Quantcast
Channel: Attunity Integration Technology Forum
Viewing all 411 articles
Browse latest View live

Project Documentation

$
0
0
Q: Does Compose generates project documentation?
A: Starting Compose version 2.8, Compose has an option to generate project documentation including model, entities, attributes, ETL, DDL, impact analysis, lineage, etc.

User Authorization changes for Replicate 5.1.1+ may cause "not authorized" issue

$
0
0
With the introduction of Replicate V5.1.1 the traditional method to store the user
authentication using the ~\Replicate\data\Userconfiguration.xml file was replaced by
an entry in ~\Replicate\data\GlobalRepo.sqlite created upon first activation during the upgrade.

[ Specifically column 'json' in table 'objects' where type = 'AuthorizationAclDto']

The recommended, main, and only supported method to manage the UI Authentications is
through the (new) "User Permission" tab under the "SERVER" page for the Replicate Console.

This new UI access above is a very nice replacement for editing an obscure XML file!

However, it is a challenge for scripting/command-line access.
Read on for a Powershell script to help out for that.


Along with this change, in preparation for new Enterprise Manager features, Replicate also changed some implementation details as to how it verify authentication.
Earlier Replicate used a windows function that asked “does user X belong to group Y”.
For 5.1.1 and up it uses a different windows call that will ask the domain where the group is from to get all the groups of for the user user, and check if X belongs to any of the groups.
That call requires more permissions, and may fail, causing previously successful authentications to fail, making UI access impossible.

Typical error message: "You are not authorized to use the Attunity Replicate console."

If there is a 'lock out' after upgrading or otherwise, you may want to try to restart the Replicate UI service using an AD account, not the default 'local system'.

Or, one can try to add users from the the local domain, not from 'somewhere in the forrest' to the admin group to regain UI access, but the UI is needed for that!
Now what?

Option 1) - Recreate

Let Replicate re-create the authentication entry from a carefully prepared Userconfiguration.xml
If this new row does NOT exist when the Replicate UI service is started, then it is
created from Userconfiguration.xml, and that file is renamed to saved_Userconfiguration.xml


Therefor the whole-sale method for fixing/importing/replacing the authentications is

  1. Stop Replicate UI service
  2. Open GlobalRepo.sqlite; delete objects where type = 'AuthorizationAclDto';
  3. Put desired Userconfiguration.xml in place (in data folder)
  4. Start Replicate UI service





But what it there is a problem with those Authentications and the Console can not be used?
Well, one could tweak (saved_)Userconfiguration.xml, and the to UI import as per above.
That would be supported.

Option 2) - SQLite through attached Powershell script.

Alternatively this PowerShell script allows one VIEW and MODIFY the Authentications outside of Replicate.
This is done by SQLite access to the GlobalRepo sqlite database.
Once the desired changes are made, restart the UI service and presto.

Here is the HELP for the script:

Code:

PS C:\> .\replicate_userconfiguration.ps1 help


    replicate_userconfiguration.ps1  Hein van den Heuvel, Attunity, 22 November 2016


        This script can be used to LIST, ADD or DELETE Replicate UI Authorization data
        without having access to the GUI or Replicate runtime components.


        This script is only useful for Replicate startign with version 5.1.1
        Earlier Replicate versions used ~\Replicate\data\Userconfiguration.xml.


        This version store similar data in Json in an entry in a SQLite database.
        A SQLite powershell module MUST be in the PowerShell Module load code path.
        Download suggested from: https://psqlite.codeplex.com - Remember to Unblock!
        ( $env:PSModulePath = C:\Users\Hein\Documents\WindowsPowerShell\Modules;
                              C:\Windows\system32\WindowsPowerShell\v1.0\Modules\;
                              C:\Program Files (x86)\Microsoft SQL Server\110\Tools\PowerShell\Modules\; )


        Usage examples:


            .\replicate_userconfiguration.ps1                        ---> list
            .\replicate_userconfiguration.ps1 ADD ADdomain\Username  ---> Add User to ADMIN group




    Main Argument:
               
[LIST|ADD|DELETE] [ADdomain\Username]


    Main Options with their defaults:
                -Action    LIST, ADD, DELETE, HELP                  : help
                -Name      ADUsername or ADGroup to ADD or DELETE    : <no default>
                -Role      'Admin','Designer','Operator' or 'Viewer' : ADMIN
                -Type      'Users','Groups'                          : USERS
                -Denied    True or False                            : False


    Optional environment settings
                -Data      Directory Path for Replicate Data        : C:\Program Files\Attunity\Replicate\data


Enjoy!
Hein

btw...
Should trouble persist, a support can will be needed. In that case, as a preparation please try to acquire some additional debugging info.
To do so edit the file ~replicate\bin\repuictl.exe.config <add key="LogDebugOverwrite" value="Authorization"/> , restart the UI service.
Attached Files

SYS-E-CREATESESS error

$
0
0
I installed Replicate 5.0.2 on Windows 7 SP1 computer as a server and can access it with local consol.
But when I try to access from a remote computer, which is on the same network with the server, there's an error below:

SYS-E-CREATESESS, Failed to create a session with the server(server response status is Request to https://192.168.1.28:3552/attunityre...e/login/failed).

What am I supposed to do?

SYS-E-CREATESESS, session creation fail

$
0
0
I installed Attunity Replicate 5.0.2 on Windows 7 SP1 as server and I can access the Attunity Repolicate Consol from the local server.
But when I try to access it from a remote computer with the same network there's an error below.

SYS-E-CREATESESS, Failed to create a session with server(server reponse status is Request to https://192.xxx.xxx.xxx:3552/attunit...e/login/failed).


What am I supposed to do to resolve it?

What is Attunity Compose for Amazon Redshift?

$
0
0
Answer: Attunity Compose for Amazon Redshift automates and streamlines the design, creation, loading, management and updates of data warehouses and data marts on Amazon Redshift.

Why do I need Attunity Compose for Amazon Redshift?

$
0
0
Answer: Attunity Compose for Amazon Redshift enables organizations to rapidly spin up, scale up, and iterate their data warehouse, dynamically adjusting data sources and models based on changing business requirements. This dramatically reduces the time, cost, and risk of cloud analytics projects.

What advantages does Attunity Compose for Amazon Redshift offer?

$
0
0
Answer:

· Speed. Build data warehouses and data marts in days or weeks, dramatically faster than traditional ETL tools.
· Agility. Rapidly incorporate changes to data sources, business rules, or other data model components.
· Design automation. Quickly define and deploy data warehouse structures based on proven design architectural approaches, such as Vault, Inmon, and Kimball.
· ETL automation. Automatically generation 80% or more of the “Extract, Transform, and Load” commands, reducing implementation time and resources.
· Enterprise quality. Leverage integrated data profiling, quality and lineage capabilities, and automatically generate project documentation.
· Real-time data warehousing. Relay incremental source updates with continuous change data capture technology, enabling real-time analytics on Redshift.

Placement of new columns

$
0
0
Hi Experts,

I am trying to add a column with system date for the target tables. The problem I am facing is that this new column is coming at the end of all the table columns.
Is there any way I can keep this new column at the beginning? I could not find any option to change the order of the columns. Your help would be highly appreciated.

Limitations for Using SQL DB as a target end - point

$
0
0
Hi All,

We plan to use SQL DB as a Target end-point in our project for one of the applications.
The Attunity Replicate Manual only talks about using SQL DW as a target but not SQL DB.
We know the setup is entirely different for both of them, but Is there any difference in terms of their usage?

Also do we have any limitations for using SQL DB as a target end- point as similar to SQL DW where we have limitations such as
1) Source columns with CHAR/VARCHAR data types and a non-Latin collation (e.g.
"Chinese_PRC_CI_AS") need to be mapped to NVARCHAR

2)Microsoft Azure SQL Data Warehouse does not support empty (NULL) columns.

Any help would be appreciated.

Regards,
Akanksha Bassin

How and Where to Set Internal Parameter in Advance settings in Manage Endponts

$
0
0
Hi Experts,

Need your views on how and where to set the 'Internal Paramater' showing up in Advance Setting of Manage Endpoint Connections.

Regards,
Akanksha Bassin

How can I get started with Attunity Compose for Amazon Redshift?

How to find the reason of the Suspended Table

$
0
0
Hi Experts,

We have a situation, where one of the tables failed to replicate during full load and got suspended as par the log.
We could not find any significant error in the log file.

We got to know from the user manual that the suspended table details are stored in a table called 'attrep_suspended_tables'.

Can you help with where exactly does this table gets created. We currently do not have access to the target database and the person who does have says he doesn't see any such table in the schema where others tables got replicated.

Any help would be appreciated.


Regards
Akanksha

Change tracking for Updates not working

$
0
0
Hi everybody,

I'm new in using CDC for Oracle to transfer data to SQL Server. I have setup and configured everything and inserts of new data in Oracle DB are tracked and transferred correctly to SQL Server.
But for updated values in Oracle only the value of this updated column is stored in the system table on SQL Server. All other columns of this table have NULL!

Name:  CDC_Issue.PNG
Views: 0
Size:  21.5 KB

Had anybody this behavior before? How can it be solved? Maybe I did something wrong in the configuration of CDC Service.


Thanks for your support!


Best regards,
Rainer
Attached Images
 

Near real time

$
0
0
Does Compose support near real time processing?

Issue while loading data from Oracle system

$
0
0
Hello Experts,

While loading data from Oracle to target system, I am getting below error.
Another thing is that data is getting loaded correctly for first exact 4,000 rows and then task gets failed.

Any kind of suggestion would be helpful.

00008956: 2016-12-08T06:28:46:935795 [TASK_MANAGER]T: Start control thread (replicationtask.c:2334)
00008956: 2016-12-08T06:28:46:935795 [SERVER]T: Going to load 'oci.dll' library (system.c:432)
00008956: 2016-12-08T06:28:46:935795 [SERVER]T: Going to load 'oraxml12.dll' library (system.c:432)
00008956: 2016-12-08T06:28:46:935795 [SERVER]T: Going to load 'oraxml11.dll' library (system.c:432)
00008956: 2016-12-08T06:28:46:935795 [SERVER]T: Going to load 'oraxml10.dll' library (system.c:432)
00008956: 2016-12-08T06:28:46:935795 [SERVER]E: Failed to load the library 'oraxml12.dll' [720126] (system.c:448)
00008956: 2016-12-08T06:28:46:935795 [SERVER]I: Failed to load OraXML library, XMLType will not be supported (oracle_endpoint.c:194)

Thanks!

Error while using Oracel as source for CDC replication

$
0
0
Hello Experts,

We are getting error for CDC when using Oracle as source

00002944: 2016-12-15T02:35:43:867286 [SOURCE_CAPTURE ]E: Oracle CDC stopped [1022301] (oracdc_merger.c:1055)
00002944: 2016-12-15T02:35:43:867286 [SOURCE_CAPTURE ]E: Oracle CDC stopped [1022301] (oracdc_merger.c:1055)
00002944: 2016-12-15T02:35:43:882916 [SOURCE_CAPTURE ]E: Error executing source loop [1022301] (streamcomponent.c:1540)
00002944: 2016-12-15T02:35:43:882916 [SOURCE_CAPTURE ]E: Stream component 'st_0_Oracle_XXX' terminated [1022301] (subtask.c:1515)
00002944: 2016-12-15T02:35:43:882916 [SOURCE_CAPTURE ]T: Free component st_0_Oracle_XXX (oracle_endpoint.c:49)
00002944: 2016-12-15T02:35:43:882916 [SOURCE_CAPTURE ]E: Error executing source loop [1022301] (streamcomponent.c:1540)
00002984: 2016-12-15T02:35:43:882916 [TASK_MANAGER ]E: Task error notification received from subtask 0, thread 0 [1022301] (replicationtask.c:2047)
00002944: 2016-12-15T02:35:43:882916 [TASK_MANAGER ]E: Stream component failed at subtask 0, component st_0_Oracle_XXX [1022301] (subtask.c:1350)
00002984: 2016-12-15T02:35:43:898537 [TASK_MANAGER ]W: Task 'Oracle_To_SQLDW' encountered a fatal error (repository.c:4425)
00002944: 2016-12-15T02:35:43:882916 [SOURCE_CAPTURE ]E: Stream component 'st_0_Oracle_XXX' terminated [1022301] (subtask.c:1515)
00005000: 2016-12-15T02:35:43:914161 [SORTER ]I: Final saved task state. Stream position timestamp:2016-12-14T17:31:15, Source id 1, next Target id 1, confirmed Target id 0 (sorter.c:557)
00003920: 2016-12-15T02:35:44:23544 [SOURCE_CAPTURE ]T: Free component Utility Source (oracle_endpoint.c:49)
00006872: 2016-12-15T02:35:47:547096 [SERVER ]E: GEN-E-MESSAGE, Unexpected EOF detected: requested to read 16 bytes, actually read 0 bytes [1020601]

Thanks!
Chetan

Exact DB changes and grants to be provided to enable CDC in oracle source

$
0
0
Hi Experts,

I have performed the below steps but still getting an error while performing the CDC for oracle source. Attached is the log for the same.
Could you help me with the exact grants to be provided.

STEPS TO ENABLE DATA LOGGING FOR CDC:
1)

1. SELECT on V_$LOGMNR_LOGS TO <USER_NAME> ;
2. SELECT on V_$LOGMNR_CONTENTS TO <USER_NAME> ;



2) Enable supplemental logging by executing the following query:

Query:
ALTER DATABASE ADD SUPPLEMENTAL LOG DATA;

3) Turn On the Archivelog mode
Query:

ALTER DATABASE ARCHIVELOG;
Attached Files

Error in performing CDC for Oracle Source

$
0
0
Hi Experts,

We have another case where we have given all the grants mentioned in the attunity guide to the user but still are facing issues in performing CDC
for an oracle source.

Attached is the log for the same.

Any help would be appreciated.

Regards,
Akanksha
Attached Files

Replicate Teradata views

$
0
0
Hi Experts,

We are trying to replicate views available in Teradata. In the table list, we are able to see all the tables not the views. Teradata ID has all required privileges
Can anyone please let me know what could be the issue and also how we can resolve it.

Thanks!
Chetan

(Please feel free to move this topic to relevant section if this is not the correct section.)

Extracting Attunity Replicate statistics and jobstatus data from the SqLite databases

$
0
0
Hi

I am trying to set up a job that reports the current status of our different Replicate jobs.

I have been able to do the needed with the help of the nice Powershell script that Hein has made available here: http://forums.attunity.com/forums/re...iple-3253.html
(with the addition of the possibility to extract the taskstatus to file)
where he uses the REPCTL executable to extract the data.

I am Running SQL Server Integration Services, so to get the data from the text format extracts i need to do some textjuggling and json extraction to get it into SQLServer

I stumbled upon the fact that all the data that is reported by REPCTL is saved in SqLite tables assigned to each Attunity Task.
If i could extract the data from that database directly, I could save myself from the text manipulations.

I have managed to set up ODBC connections to the SqLite tables of one of my jobs and extract what i need.

My questions is:
Will this odbc extraction interfere with Attunity's own use of the tables in any way?
- could i block for updates from attunity by having this job running each hour

regards

Peter Tilsted
Viewing all 411 articles
Browse latest View live