All Questions
Tagged with talend oracle-database
81 questions
0
votes
1
answer
405
views
What is the best way to consume a WebSocket API for PowerBI via OracleDB?
My data source is a WebSocket API that provides a channel to listen to.
The final destination is for use in PowerBI for near Real-Time reporting.
Ideally I need to first write this data to an Oracle ...
- 81
1
vote
0
answers
592
views
java.sql.SQLException: Protocol violation: [6, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 1]
I'm using Talend 6.5 to connect some Oracle DB with a few big query.
Sometime (but I can't reproduce every-time), the same query crash with the following error :
job.job.my_job - tOracleInput_10 ...
- 5,894
0
votes
0
answers
196
views
How to Convert varchar Data type to Cassandra Map (Key value pair) conversion in Talend
I am trying to load varchar2 Data from Oracle to Cassandra Map data type(key value pair) using a Talend Mapping. I have tried TConvertType, Tdenormalize and TJavaFlex Components to convert such ...
- 1
0
votes
0
answers
352
views
Update ~30 million records in SCD-2 on daily basis
I have a SCD-2 table which holds 400M+ records. On daily basis I get 40M records out of which ~20M gets inserted & updated. I use Talend & Oracle for this project. The problem is it takes a ...
- 1
-1
votes
1
answer
169
views
Transfer xml data to Oracle table by column or fields by using talend
I am using Talend Studio with objects tFileInputDelimited row1(Main) to tOracleOutput what I want is to transfer the data in xml file to Oracle table.
I want to transfer the values of the last two ...
- 49
0
votes
1
answer
463
views
Datatype conversion using tdbrow of talend
I really need your help,i was using tdbsp (stored proc) before but now i need to use tdbrow for performing an insert into one of the oracle tables as part of the job flow.
Some of the columns in the ...
- 1
0
votes
1
answer
6k
views
Unable to determine the cause of the "ORA-00922: missing or invalid option" error
I am getting "ORA-00922: missing or invalid option" error when I try to run a Talend job to load data from an Oracle script to a database table
The script itself has been tested and ...
- 315
0
votes
1
answer
1k
views
Insert into a table using tdbrow talend -casting datatype or conversion issues?
Tdbrow:
In the brackets i have indicated their predefined datatype in the table!
insert into FILETABLE
(ID (number), DIR(number), file_name(varchar2), file_date(date),file_size(number))
...
- 1
0
votes
1
answer
645
views
Why my oracle to_date is returning this error ORA-01861: literal does not match format string
I'm trying to use java and SQL in talend and I'm getting the following error ORA-01861: literal does not match format string
Here my java code:
Date supply_date_last_filter = new Date();
Date ...
- 21
0
votes
1
answer
1k
views
How do i store the results from an db(oracle) query as a global variable to be used in a RUN-IF condition in talend?
I have a dbinput component where i am using an select statement as below:
"select file_name,file_size from dat_file where file_name = '"+(String)globalMap.get("...
- 55
0
votes
1
answer
5k
views
How to capture the output after querying the tdbrow in talend and display it?
I am extracting the filename from tfilelist and i am checking against the database if that filename exists in the table and display the corresponding output?
I cannot see the output when i tried with ...
- 55
0
votes
2
answers
912
views
How to check if a file retrieved from the ftp site exists in the local folder in java using talend?
I am using FtpGet to extract or retrieve a file from the ftp and loading into the database and before that i am storing in a local folder.
So before i use tfilecopy to the local Folder i would like to ...
- 55
1
vote
1
answer
855
views
how to execute PLSQL script from tOracleRow component using Talend?
I am new to Talend. I am using Talend 6.5.1 version and Oracle 11.
I have created a simple table in Oracle.
Table DDL:
CREATE TABLE test(id NUMBER);
Now, I am inserting records with following Talend ...
- 1,352
0
votes
1
answer
522
views
Talend tFileInputDelimited to tDBoutput ORA-00904
I made a job design which consists of tFileInputDelimited -> tMap -> tDBOutput(Oracle)
The csv I am using has columns which are not currently in the table which I don't think should be a problem....
- 7
0
votes
1
answer
450
views
How to catch DB Error in Sub Job in Talend
I have the below design in Talend I am catching the error when the component fails but if there is any error from DB like Cannot Insert as Parent Key not found Cannot Insert into column col2 expected ...
- 1,620
0
votes
0
answers
2k
views
How to prevent oracle database Connection timeout issue without connection pooling
I need to read around 80k ids from oracle and should iterate on each id to again use the id to query against oracle to fetch that data for that particular id and process it. But when reading the 80k ...
- 95
0
votes
1
answer
633
views
Oracle ora_rowscn to get delta [duplicate]
ora_rowscn as definition from oracle,
You cannot use this pseudocolumn in a query to a view
so can I use the ora_rowscn column to get the delta and updated data from the oracle table in my ETL job?...
- 15
0
votes
1
answer
2k
views
Execute Stored Procedure Talend
I try to execute a stored procedure with Talend 7.1.1. That procedure is registered in DB 'SYS' and she TRUNCATE the table in parameter (my table : ODS.TEMPF_PRODUCTION)
I put the composent tDBSP (...
- 321
0
votes
1
answer
754
views
Talend : Truncate Table and insert data from a view
i'm working on a job with Tos for ESB 7.1.1. I'm trying to connect to a DB (ORACLE), recover my ID_MAX and save it, TRUNCATE my table and insert data from a view and for each line increment my ID.
...
- 321
4
votes
3
answers
1k
views
How to get column names from a query?
I have a specific query with joins and aliases, and I need to retrieve columns name for a REST request in Talend.
I'm using Talend Open Studio for Data Integration 6.2 and I've got an Oracle 11g ...
0
votes
1
answer
184
views
Oracle Spool file via CMD command deliver more Data than expected
i have a Oracle Table "Sales" with columns ID,Sales,TIMESTAMP. Data looks like this:
ID Sales TimeStamp
1 30 2018-08-20 00:00:00.989900 +02:00
1 35 2018-08-21 05:00:00.989900 +02:00
...
1 ...
- 305
0
votes
0
answers
235
views
How to generate oracle rank and dense_rank function in Talend?
SQL> select ID,rank() over(order by ID) RANK , dense_rank() over(order by ID) DENSE_RANK from a;
ID RANK DENSE_RANK
1 1 1
1 1 1
2 3 2
3 4 ...
- 11
0
votes
2
answers
585
views
Talend Create Select Performance tuning
I just realised that when I run a create select statement on my Oracle 11g database the execution is about three times faster than using Talend to select the data then creating and writing the data ...
- 4,939
0
votes
1
answer
307
views
Talend how to use an Oracle database created sequence
I've created a sequence object in Oracle DB and I need to assign it to a context variable in Talend and so that I can increment the value from Talend.
How can I do that? What component should I use ...
- 2,838
2
votes
1
answer
123
views
How to pass dashed strings to oracle from a query written in java
I have a problem with this query when I pass it to an oracle dbms
SELECT * FROM RD_RBF WHERE REQUEST_ID = 'S2N-F01-000000000001'
because of the dashes in the string the jvm return me this exception
...
- 21
0
votes
2
answers
103
views
send Email with new record from Database query
i have query which give me information of ETL Error like this:
i create a Job: tOracleinput --->tsendMail which sends this Error logs to my Email.
What i want now is that: when i execute the Job ...
- 305
0
votes
1
answer
708
views
Transfer CSV data to Oracle table by Column or fields using Talend
I am using Talend Studio with objects
tFileInputDelimited row1(Main) to tOracleOutput
what I want is to transfer the data in CSV file which are
cell delimited (looks like an excel record) to Oracle ...
-4
votes
1
answer
121
views
how to bind varible in sql/plsql
My query is
with dates_table as (
SELECT to_date(:begin_date, 'dd/mm/yyyy') + ROWNUM - 1 cal_day
FROM dual
CONNECT BY LEVEL <= to_date(:...
- 41
0
votes
1
answer
335
views
Adding Oracle Database driver to ESB server
I am new to ESB and have the Talend Runtime installed on my local machine and am able to run it partially. By partially I mean the child job of the ESB service does everything EXCEPT for performing an ...
- 191
0
votes
1
answer
414
views
Migrate tables with special characters in Talend studio
I am migrating from table A (DB A) to table B (DB B), an error occurs on 1 specific field that contains french characters (é, à, ..) and special characters (&, ', ..):
Exception in component ...
- 93
2
votes
1
answer
81
views
Querying a database again and again or storing all the data in a file at once and querying the files?
I am making a set of Talend jobs where I am going to query same set of tables differently depending on the need of the jobs. These tables are huge. Will it be good if before running the jobs I query ...
- 1,030
0
votes
2
answers
639
views
talend - output of tReplicate to subjob
My planned flow is as follows:
subJob1
/
tOracleInput -> tMap -> tReplicate -- subJob2
...
- 6,261
0
votes
1
answer
287
views
talend - split one row into multiple rows based on some logic
Currently here is my flow:
tOracleInput -> tMap -> tFileOutput
The output of the select statement in tOracleInput is something like this:
ID | Name | Amount | PercentageOfMixed | ...
- 6,261
0
votes
0
answers
34
views
Talend Component "OracleInput" don't find datas
I have a problem on Talend Open Studio for Big Data, for a project i ahve to import in MongoDB datas which come from an Oracle Database.
The problem is my connection to Oracle is correct, but with ...
0
votes
1
answer
1k
views
talend - tMap output into list
I have the following flow:
tOutputFile (will output many fields)
/
tOracleInput -> tMap -> tReplicate
...
- 6,261
0
votes
1
answer
733
views
talend - output of tMap to another query
I have a one view query (which is quite heavy) so I want to avoid re-querying again.
The output of this query is transformed and put into the file. There is a unique reference number on this file (...
- 6,261
4
votes
2
answers
399
views
talend - specify jndi as datasource
I have a talend job that uses tOracleInput component with connection type of ORACLE CUSTOM. It is working well.
Now, I have a requirement to use jndi as the database connection. Any ideas how can ...
- 6,261
0
votes
1
answer
505
views
Talend-Unable to use Context variable in oracle query
I am facing challenge in calling a context variable in my oracle source query
select branch_code from sttms_branch where
country_code='"+context.con_contry_cd+"'
No rows are fetching.But if we ...
- 39
1
vote
1
answer
399
views
Talend ETL jobs calling through Web Service
Our requirement is to call "Talend ETL job" from another application sources like Salesforce, Jira & others.
Can someone please guide me for process steps needs to be used for calling "Talend ETL ...
- 11
0
votes
1
answer
2k
views
Update or Insert into postgres table without any primary key
I have a table which needs to be ingested from Oracle source to Greenland target using ETL tool talend. The table is huge , hence we want to load the data on daily basis incrementally. The table ...
-1
votes
1
answer
508
views
Not able to connect to oracle database using context variables talend open studio for Big Data
I had created context group: using context variables for database connection imported from Oracle db connections in meta data.
While running the job it is throwing the following error:
Exception in ...
1
vote
4
answers
3k
views
Where to find tns.jar for Talend tOracleConnection
I am working on creating an Oracle connection in Talend.
When I configure the tOracleConnection component, I install the prompted ojdbc.jar with no issues.
When I start to use this connection it ...
2
votes
1
answer
2k
views
How to do a simple Talend Upsert with timestamp column
I'm trying to create a Talend job which will do the following:
Take input rows and insert or update into an oracle table
If the row already exists in Oracle table, check if it needs updating based ...
- 1,483
-3
votes
1
answer
520
views
CDC for 100 tables in TalenD
I am new to CDC, have a query. I have say 100 tables where i cannot create a subscribers for 100 tables to capture the data change using TalenD. Is their any way to capture for all the tables ...
0
votes
1
answer
495
views
Data when loaded from oracle to greenplum via talend is not handling CLOB columns well
I am using tOracleConnection to connect to the oracle source and tOracleInput to fetch the data, then tMap and then writing the data to a file using tfileoutputdelimited (custom component)
From file ...
1
vote
1
answer
194
views
Return last ID from a column
Is there a way to return the last ID from a column (called ID_MES) without browsing through all of the records?
My job Talentd:
0
votes
1
answer
108
views
how to count number of lines with jointure in Talend on Oracle
i have 3 tables
supplier(id_supp, name, adress, ...)
Customer(id_cust, name, adress, ...)
Order(id_order, ref_cust, ref_supp, date_order...)
I want to make a job that counts the number of orders ...
0
votes
0
answers
801
views
How do I resolve protocol violation that occurs on only one table in Oracle 11?
The protocol violation is only happening on one table out of many.
Oracle DB Version: 11.2.0.4.0
Using: ojdbc6.jar
Stack Trace:
java.sql.SQLException: Protocol violation
at oracle.jdbc.driver....
- 38
0
votes
2
answers
599
views
talend etl oracle error 0 row insert
I am a newbie to TalendETL and am using Talend Open Studio for Big Data version 6.2.
I have developed a simple Talend ETL job that picks up data from a tFileInputExcel and tOracleInput(dimension date ...
0
votes
2
answers
95
views
How to create configuration to specify Source(DB) and Destinations dynamically in Talend?
I have to move data from Oracle to PostgreSQL on Amazon cloud. I want to know if there are any ways to take care of configuration related issues.I want to take connection string ,userID, password and ...
- 183