2,791 questions
0
votes
1
answer
26
views
tFTPConnection in talend open studio for data integration
i made an FTP connection to a remote ftp server it is working great but i have a problem with the password, on that machine the password changes every 2 weeks, is there a way to make an ftp connection ...
0
votes
0
answers
28
views
two namespaces with the same value in advancedfileoutputXML Talend
I have 2 namespaces with the same value
xmlns:(default) with static value http://www.energistics.org/energyml/data/prodmlv2
xmlns:prodml with static value http://www.energistics.org/energyml/data/...
- 15
0
votes
0
answers
30
views
Talend ESB / Karaf : Get datasource from CamelContext / registry
so first I'm new to Talend ESB, Camel and Karaf and I'm facing an issue when I try to get a datasource (that has been created on a Karaf instance).
Here is the DataSources GBMREFPPR, is the one I'm ...
- 519
0
votes
1
answer
54
views
Not able to fetch specific partition data from tKafkaInput in Talend
We have a Kafka topic distributed across 3 partitions, and I need to fetch/read data from partition 1 in one job and partition 2 in another job. I have tried using several Kafka parameters in the ...
0
votes
0
answers
39
views
Get Recently Inserted Data in Talend
I am inserting data form a PostgresDB to another with Talend ETL.
I insert data in a table called file, and one of the fields is size.
After i insert the data I would like to sum the size of files ...
0
votes
0
answers
18
views
multi threading while using tMOMInput in keep listening mode
simplified scenario:
have a job that is listening to MQ using tmominput in keep listening mode. For every incoming message, needed data is extracted from the incoming message and passed on to a subjob ...
- 31
0
votes
0
answers
34
views
How to extract some occurences in XML source with Talend routes / Camel
I need in a Talend route to keep only the occurences of an XML message body that have a specific value.
Example : If I required for T1 occurences,
<root>
<occ>
<name>A</name>
&...
- 126
0
votes
1
answer
72
views
how to set proxy for tRest component in talend
i'm trying to set proxy for tRest component but its not working.
i have used tsetProxy component before tRest component.
in tRest Component we dont have to set proxy for execution like we have option ...
- 1
0
votes
1
answer
33
views
Talend Data Load Issue (DataStage)
Please help with the below scenario
I have incoming file data which I need to load to a Oracle DB.
There are around 1200 fields/columns in the table (the data from file has to be fed to these columns)...
- 147
0
votes
0
answers
31
views
Discrepancy between Stitch (GA4 API) extracted data and Ga4 UI Data
We are extracting ga4 data via the given api through stitch into our data warehouse.
However when we aggregate the metric "total_users", we found 12% discrepancy between data that is shown ...
0
votes
0
answers
29
views
How to split address in talend into separate columns
I want to split the below address from single column to multiple columns using talend from csv file to database table.
Input
|ADDRESS|
2660 9 SHERWOOD HEIGHTS DR W OAKVILLE ON L6J 7Y8
Expected Output
...
0
votes
0
answers
28
views
Talend hierarchical (parent-child) relation expression
I am struggling with parent-child relation in Talend. I have two tables (crm and sms) which are connected between each other.enter image description here
Initially ParentId of sms is empty or ...
- 1
0
votes
0
answers
23
views
Not able to connect MySQL 8 on local machine from Talend 6.4
I have installed Talend DI tool for learning purpose but when I try to connect it with MySQL 8 version it showing error "Could not create connection to database server".enter image ...
- 1
0
votes
1
answer
47
views
Talend Run subjob if one value is true
I have tFilterRow component that accepts only when today falls into a specific day in my date list, i.e. actual is true. I want to run my subjob if this value is true, else kill the subjob.
My if ...
- 35
0
votes
1
answer
300
views
How to display Talend tDbRow output?
I have to output the result of the query in tDbRow, here "show datestyle;" in a Postgresql database as an example.
What i did :
And now, how do i display the output object ?
Sadly, the ...
- 189
0
votes
0
answers
52
views
Controlling email delivery in Talend job
I need to send emails to multiple users based on the email addresses in the file. I have To email Id and the BCC email ids in the file. The file is a pipe delimited file. The records in the file look ...
- 1
0
votes
0
answers
44
views
Talend Data Catalog -Displaying Specific Models to Users in Talend Data Catalog
I need some assistance with Talend Data Catalog. In the Repository under the Manage section, I created a new folder called "DI_JOB," which contains three models: a connection to Excel and ...
0
votes
1
answer
88
views
How do I split an array of jsons using tExtractJSONFields Talend component?
Suppose a field contains this Json, (an array of 3 Jsons) -
[
{"id": 1 , "name": "name1"},
{"id": 2 , "name": "name2"},
{"...
0
votes
0
answers
43
views
can all my dimension tables hav the same primary key?
I have the below tables:
info: (symbol/ country/ city/ address/ market/ industry...)
balance sheet: (symbol/date/ total debt/ total assets...)
income statement: (symbol/date/ net income...)
statistics:...
- 1
0
votes
0
answers
38
views
Dynamic Column Mapping in Talend
Want to read the csv file that has different number of columns every day
Problem: I have a 4 to 5 csv files that come in daily all of them have the same purpose. They are generated by a logger. Now I ...
0
votes
0
answers
40
views
Talend job failing with coummunication error while closing mysql connection
I have a talend job which is failing with below error while closing the connection. Talend jobs are scheduled using airflow. The error gets resolved if I re-run the job from airflow. This is not ...
- 1,178
0
votes
1
answer
76
views
Unable to use both SQL Server and Postgres connection together on the same job - Talend
For a test, I created this simple Talend job:
The tRowGenerator generates a row with int column and is staged to temporary database in Postgres.
The issue occurs whenever I run the job. The ...
- 3,077
0
votes
0
answers
44
views
Why do i get random characters as a response to my curl get call in php?
I am trying to get a list of deliveries using this GET call:
https://datalink.hconnect.digital/api-products/basic#get-https-//api.hconnect.digital/ecs/v2/deliveries
Here is a picture if the link is ...
- 1
0
votes
0
answers
37
views
No icons on Talend Open Studio Interface on linux
I have just installed the latest Talend Open Studio in Ubuntu linux and no icons are showing in the interface, just red squares like in the image:
Someone know how to fix it? I'm using Ubuntu 22.04, ...
- 111
0
votes
1
answer
252
views
Error in Talend Studio: Command org.eclipse.jgit.api.PushCommand was called in the wrong state
I am currently using a Remote TAC connection to access my Talend Studio, and I encounter the following error when I open the Studio with this connection:
Command org.eclipse.jgit.api.PushCommand was ...
0
votes
0
answers
24
views
Talend 8.0.1 - Insert POINT data type into postgresql from csv file [duplicate]
I'm using Talend Open Studio 8.0.1 and I'm trying to import data from a csv file into a postgresql database.
I'll provide a simplified example of my specific issue :
My test.csv file is as below :
id,...
- 23
0
votes
0
answers
64
views
Issues accessing RHEL 9 from tssh component on talend
When connecting to rhel9 server by tssh component on Talend i am facing below error :
Exception in component tSSH_3 (sample_ssh)
java.io.IOException: There was a problem while connecting to ...
- 1
0
votes
0
answers
38
views
Date conversion issue in Talend tool
I am trying to load data from MySql db to Oracle database using Talend. I am able to load upto 1+L records after that I am getting below
java.sql.SQLException: HOUR_OF_DAY: 2 -> 3.
MOre details:
I ...
0
votes
0
answers
75
views
Error importing project Talend open studio for data integration
When I was importing a project in Talend Open Studio for Data Integration, I encountered this error.How can I fix it? I use talend open studio for data integration v6.4.1 . With other version of ...
0
votes
1
answer
168
views
Extracting more than 25 rows from REST API using tRest and tExtractJSONFields
I'm currently working on extracting data from a REST API using Talend's tRest and tExtractJSONFields components. However, I'm facing an issue where I'm only able to extract a maximum of 25 rows, ...
0
votes
0
answers
128
views
Missing Components ( TSQLScriptParser, TSshTunnel ) from talend Palette
I tried with Talend Open Studio for Data Integration Kit version (8.0) and also with (version 7.3.1) and i have the same problem (Missing components in talend palette)
I downloaded version 8 of Talend ...
1
vote
1
answer
52
views
Get Count from tRest in Talend
I am using a tRest component to get data from a web service.
The tLogRow indicates a count value that I would like to get, but don't know how.
{"result":[my data blabla multiple fields],&...
0
votes
1
answer
50
views
Manually setting variable on a talend subjob
I've got a main job (a) that sets the reference date for the extraction of some data and a sub job (b) that take the reference date from a and does the extraction.
Is there a way to launch a from ...
0
votes
0
answers
43
views
Talend bulk exec component deletes the source before loading the destination and simply loads nothing
I'm trying to use the tSalesforceOutputBulkExec component to UPSERT some data coming from a .csv file.
We have about 60 jobs doing the same thing and they work fine, but every time I try to load the ...
- 1
0
votes
1
answer
208
views
Processing group of rows in same batch in Talend Open Studio for Data
I am using Talend studio coupled with Salesforce components and I am facing a case where I want to be able to load within the same batch
My data looks like below, where each row has this configuration
...
- 142
0
votes
1
answer
132
views
Data output after TJavaFlex
I use a TJavaFlex with different parts like in the images.
In the System.out.println, i have all lines (2000) but the TLogRow have nothing and not all lines. I dont know why.
0
votes
1
answer
68
views
tRest component giving different output
In talend I am using tRest component to make an API call. When i browse the API Url I am getting the desired json output it should be giving.But in the job, when I call the API I am getting an HTML ...
0
votes
0
answers
84
views
Talend how to handle multiple row headers?
I am building a pipeline using Talend to ingest data from Share point and output to Snowflake. Currently using dynamic schema as there will be many other files with different structure.
current ...
0
votes
0
answers
63
views
Talend TOS synchronization problem tflowtoiterate
I have a flow which retrieves countries and cities in an excel file and which will execute a query with the city on a database and which will save the result in a file bearing the name of the country,...
- 93
0
votes
0
answers
21
views
Talend file name with year validation
Talend, From the list of files fetched by tFileList , I need to check files belongs to this year and move to one location. Files outside this year, need to move to another location
How to check the ...
- 1
0
votes
0
answers
30
views
how to extract data fiscal year wise in talend dynamically
I need to extract data fiscal year wise, which are the components I need to use and the expression in the component to extract data fiscal year wise?
I have used tflowiterate but am getting year wise ...
- 1
1
vote
1
answer
351
views
Talend Open Studio (6.5.1) tMap join with <= / >= condition
My problem is joining 2 tables in a Talend(Open Studio 6.5.1) process, but I cannot realize the join condition.
I use a tMap component to do the join. I know that I can do a lookup on all the data (...
- 27
0
votes
1
answer
70
views
tLogRow: log only when the row has an error [Talend 7.3]
I have a school project and I must use Talend 7.3 as my ETL.
I am using tLogRow in a job that processes millions of rows. I don't want to lose the errors that might happen when processing a specific ...
- 1
0
votes
0
answers
27
views
How can I kill spid with talend
When I try to 'Kill Spid' with Talend it doesn't work.
How can I handle this sitiuation?
When I try, Talend returns the result as below and does not close the session.
"kill command cannot be ...
0
votes
1
answer
310
views
Talend : How to use tReplaceList to find and replace CR LF (newline) in string
I have some data coming from an Oracle database that contains "CR LF". I use a tDBInput component to read that data and feed it into a Redshift table.
In the middle I have a tReplaceList ...
- 1
0
votes
0
answers
34
views
PGSQL - How to optimize execution time for query stored into a varchar column
I'm currently working for a client that need product theoric price redirection getting the minimum sub-value whenever the initial-value is null
My question is how can I speed up reloading time with ...
- 5
0
votes
0
answers
28
views
Issue with Hazelcast_Blueprint.xml while using KARAF
While deploying the Hazelcast_Blueprint.xml file for setting up a Talend webservice in Karaf, i am getting the below error:
tadmin@trun()> bundle:diag Hazelcast_Blueprint.xml
Bundle 3167
Status: ...
0
votes
0
answers
145
views
Running AWS EMR via Step Functions - How to have have "Terminated with errors" when a Step Fails
I'm in the process of migrating ETL jobs from Talend to AWS. The ETL Jobs are pyspark scripts that run on AWS EMR. A typical job on Talend will run multiple pyspark scripts in sequence. My ...
- 623
0
votes
0
answers
83
views
Talend upload file to SharePoint (graphAPI) document libraries , file types are unknown
I have project, using Talend, where an oracle blob is decoded into a file.
I need to 'PUT' the file into a SharePoint document library. i have all the drive id's etc tested in postman as well as ...
0
votes
0
answers
43
views
Talend ETL Job SQL with if condition
I have two database (MySQl and SQL Server), I use a query that return values from Mysql for example:
ID
STATUS
1
OK
2
ERRO
3
ERRO
4
OK
5
ERRO
I would like that after the (tJavaRow_1) to check ...
