All Questions
53 questions
2
votes
2
answers
363
views
Load the data from MongoDB (tMongoDbInput) of recent rows which are not loaded yet
Background :
I have created a job which is reading data from MongoDB and loading that to MS-SQL.
Current Behaviour :
Whenever I run the job it is fetching all the data from MongoDB .
Expected ...
- 707
0
votes
2
answers
324
views
how to collect all information about the current Job in Talend data studio
I'm Running any job then I want to log all information like ---
job name
Source detail and destination details (file name/Table name)
No of records input and number of records processed or save.
so I ...
0
votes
1
answer
120
views
All output on talend open studio is not inserting in MongoDb
As Diagram and console shows the output of given job is--
Total Records
Current Job name
File property table
here's file property table is inserted in database but Total Records and Current Job name ...
0
votes
1
answer
295
views
tfileproperties not working in my case in talend open studio
I want to fetch file details like path of file, column names, and other things .In my job there are null values while using tfileproperties as shown in image added. look
if somebody can do something.
0
votes
2
answers
173
views
Extracting embedded data from mongo object ( sub fields) in Talend
I'm working on Talend open studio for Big Data and connected to a MongoDB Database ,
however i can't extract complex subfields objects from my collections,
sometimes there is 4 levels of subfields and ...
1
vote
0
answers
177
views
Reading data from MongoDB that contains array using Talend
I have a collection in my MongoDB that contains one field that is an array.
Refer to the data above, the field 'Courses' is an array.
The JSON format of the data is like this:
{
"_id": {...
- 62
1
vote
0
answers
136
views
Array with single element is not getting populated within [] in Talend using MongoDB output
I am trying to insert a JSON document with arrays into the target mongoDB and the issue I am facing is array with one element is not getting enclosed within square brackets whereas array with more ...
0
votes
1
answer
432
views
Stitch - Mongodb SSL handshake failed: <Hostname>: [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:645)
I have used the stitch data integration tool to transfer MongoDB data to stitch. But While running it
getting error as mention below
Guide me
2021-06-21 12:40:32,381Z main - INFO Running tap-mongodb ...
2
votes
1
answer
2k
views
How to connect to MongoDB from Talend Open Studio?
I am trying to connect to MongoDB database from Talend Open Studio, but am having some issues. At first, I didn't even have the components for connecting to MongoDB (tMongoDBConnection, tMongoDBInput) ...
- 33
0
votes
1
answer
413
views
How to process and insert millions of MongoDB records into Postgres using Talend Open Studio
I need to process millions of records coming from MongoDb and put a ETL pipeline to insert that data into a PostgreSQL database. However, in all the methods I've tried, I keep getting the out memory ...
- 165
3
votes
1
answer
593
views
Migrate data from Schema free database to Relational Database : MongoDB to Snowflake
We had a use case that lead me to write this and I am sure many of you would have faced this situation. The situation was to migrate multiple collections from MongoDB into Snowflake Database through a ...
- 196
0
votes
2
answers
1k
views
Unable to connect to MongoDB server using Talend
I tried connecting to MongoDB using Talend Big data solution.
Under the Metadata section, I used the "NoSql Connection" option to create a new connection, as shown below.
My MongoDb version ...
- 165
-2
votes
1
answer
160
views
How can I regroup multiple tlogRow in talend to one file where I can see all my rows?
I am working on a MongoDB database ETL, I need to prosses the data and move it to the PostgreSQL database, I used the tExtractJson in talent to extract all the documents and subdocuments but I am ...
- 29
0
votes
1
answer
443
views
Insert ObjectID in to mongo array elements in Talend tool
We are migrating the data from Oracle to Mongo DB using Talend tool and we would need to add the object Id to each object inside an array. We have tried to use attribute @type with fixed value as ...
-1
votes
1
answer
761
views
Talend : tMongoDBInput - how Use an input field in a tMongoDBInput?
In my Talend job, I have a first step to select a data in a database postgres.
After this selection, I would like to use the value of this field, in a parameter in an aggregation pipeline query :
...
- 51
0
votes
1
answer
254
views
TmongoDbInput schema not retrieving JsonArray Properly
I'm trying to retrieve below mongo collection data using TalendOpenStudio for Big Data 7.2.
T
{
"id": "5b69b66d3dae73000fa39440",
"data":"Testing"
"products": [{ "orderid":"1234"
}],
"createDate": "...
- 41
0
votes
1
answer
272
views
How to get sysdate in talend using mongodb connector
I have talend and mongodb on two different servers and two different zones ( these timezones may change in future). I am trying to set context variable in taled to mongodb sysdate. I have tried few ...
- 76
0
votes
1
answer
113
views
How to store column values from mongoDB collection to another collection as headers using talend
I have a mongoDB collection HeaderDetail with column names headerName & metricType. Below attached my collection detail,
Now, i was tried to store the headerName values as header in another ...
- 629
0
votes
0
answers
271
views
How to pass parameter from tMongoDBInput to tRestClient using Talend OS for Big Data
I'm using Talend OS for Big Data and pulling data from HP ALM. It is working fine.
Here My Working Job Flow,
tFileInputProperties-->tContextLoad-->tMongoDBConnection-->tLibraryLoad-->...
- 629
1
vote
0
answers
184
views
Writing MongoDB Collection data to a csv using Talend
I am trying to export MongoDB collection data to a CSV or JSON format using Talend, but I am unable to do that, I tried logging rows using tLogRow from tMongoDBInput, but rows are not being displayed, ...
- 49
0
votes
0
answers
132
views
RDBMS to MongoDB using Talend 6.1.2 throwing error
I am trying to convert data from ORacle to MongoDB JSON format . But when trying to convert, I am getting following error when writing to JSON field. can anyone help. I have attached the flow and the ...
- 1
1
vote
1
answer
254
views
tMongoDBOutput - Configuring JSON tree
Trying to configure JSON tree for tMongoDBOutput. Only 1 element is getting created in subelement array. Can someone please give a example of configuring the JSON tree. Requirement is one document can ...
- 109
1
vote
1
answer
973
views
How to use the output of a query as input to another query
I am new to Talend, but I want to have a job similar to this:
in a tMysqlInput, make a select statement that returns a single row with a single column and then use that value in a tMongoDBInput query ...
- 35
0
votes
2
answers
2k
views
Convert String to ISO date format in Talend
I have Excel data and trying to insert the data into MongoDB using Talend Big Data for Open Studio. This is my job,
tFileInputExcel --> tMap --> tMongoDBOutput
In excel sheet, i have a date ...
- 629
-3
votes
1
answer
62
views
Getting actual value from cummulative value in talend
How to get the actual value from the cumulative value in talend? for example
a car runs for 1000 km. next day the car will start from 1001 km. what i need is how to calculate the total kilometers ...
0
votes
1
answer
1k
views
Merge multiple JSON in one output
I'm working on a BI project when I need to combine two JSON in one output to insert in MongoDB.
Screen of job:
The first JSON is like that :
{
"idCommand": 1
"name": "Maurice"
}
The second ...
user5588850
0
votes
0
answers
34
views
Talend Component "OracleInput" don't find datas
I have a problem on Talend Open Studio for Big Data, for a project i ahve to import in MongoDB datas which come from an Oracle Database.
The problem is my connection to Oracle is correct, but with ...
0
votes
1
answer
471
views
How to pull data from excel or CSV using Talend Big Data tRESTClient API?
I'm using Talend open studio for Big Data(ver 6.4.0) and pulling data from HP ALM using tRESTClient and inserted into mongoDB. Now my ALM is down & i want pull data from any files like excel, CSV ...
- 629
0
votes
0
answers
527
views
Talend Big Data tMongoDBOutput not working properly
I'm having Talend Open Studio for Big Data(ver6.4.0) & I tried for pulling data from Jenkins using tRESTClient and inserting into tMongoDBOutput. If i select drop down option tMongoDBOutput --> ...
- 629
0
votes
1
answer
340
views
How to pass query parameters value as parameter from CMD using talend ESB6.3.1
I'm using Talend Open Studio for ESB ver.6.3.1 and created the jobs which is used to pull the data from ALM to MongoDB.In that i used tRESTClient with query parameter(date) for pulling data from ALM &...
- 629
0
votes
1
answer
609
views
How to update the mongoDBOutput data without delete?
I'm using talend for ESB to pull the data from ALM & inserting into mongoDBOutput.but i couldn't update the existing without delete.
How to update the mongoDBOutput data without delete, if data ...
- 629
0
votes
1
answer
70
views
Difference between tMongoDB component in ESB and Big Data
what is the difference between tMongoDB component of talend ESB and tMongoDB component of talend Big Data?
which one is the best for handling data like (inserting new data, updating existing data, ...
- 629
0
votes
1
answer
86
views
tMongoDBbulkLoad is not available to download in talend exchange
I have 1 million data and I have to transfer it from excel to mongodb. It is throwing heapspace error. How can I perform this job in Talend tool? I have searched for tMongoDBbulkload and it is not ...
- 629
1
vote
0
answers
220
views
Access MongoDB from Talend
I'm trying to access mongoDB from talend. I set all parameters ok since it can connect without any problem.
The problem is that I got the following error:
Exception in component tMongoDBInput_2
java....
- 2,082
0
votes
1
answer
1k
views
Regarding Talend open studio how to add mongo connections where can i get those connections and jars
I am trying to Import the CSV file into Mongodb Through Talend open studio when iam searching in palette iam not finding any mongodb connections so how to import the jars and where can get those jars ....
- 15
0
votes
1
answer
1k
views
tMongoDBRow "Execute Command" Syntax
The documentation in Talend only gives the function call example, it doesn't give and example of how to use the "Execute Command" option.
I want to simply drop a collection.
I have tried adding the ...
- 3,022
0
votes
1
answer
137
views
How to iterate over files for tMongoDBBulkLoad
What is the best way to iterate over files and feed them into tMongoDBBulkLoad? It sees that you cannot feed into this component from a tFileList componet (Iterate) - which would make the most sense.
...
- 3,022
0
votes
1
answer
1k
views
How to force an array in Talend tMongoDBOutput component
You can see here that when I have a single "location" I don't get an array, and this is causing me some issues. I am trying to create a nested document from a one-to-many relationship in Oracle.
How ...
- 3,022
3
votes
3
answers
4k
views
Why does tWriteJSONField create an array for null values?
I have joined Countries to Locations in the HR Sample database in OracleXE.
I am then using a tMap to generate a nested JSON document.
it works, but for some reason null values in the Location are ...
- 3,022
1
vote
1
answer
581
views
How to import talend build job in eclipse
I'm using TOS for ESB 6.3.0 and created one job with tRESTClient.
My Job is:
I've build the above job and created zip folder, then extracted the folder also.
Now am trying for import the job into ...
- 629
1
vote
1
answer
2k
views
Unauthorized error in Talend REST Client
I'm using Talend ESB 6.3 version & trying to pull the data from HP ALM to MongoDB. The below is my job,
In my job, I've started from "tMongoDBConnection --> tRESTClient --> tExtractXMLField --> ...
- 629
1
vote
4
answers
4k
views
Build option is not working in Talend Job
I'm using Talend ESB 6.3 and creating jobs. I tried to use the build option in working job, but it is not working even it is not showing any error.
The above "FileCopyJob" right clicked & ...
- 629
0
votes
1
answer
293
views
import Data from Excel to MongoDB in Talend
I'm using Talend ESB tool.Is it possible to copy data from "excel to mongodb" and "MySQL to mongodb" ? If it is yes, how to create the jobs? OR else any other way to achieve this?
- 629
2
votes
4
answers
476
views
Talend Data preparation : Mongodb already installed locally on this computer
I am trying to install Talend Data Preparation V1.3 on my windows server 2012R2.
I have uninstalled previous version 1.2 and deleted all directories related to it from my machine.
Now when i am ...
- 262
1
vote
1
answer
697
views
JSON import nested object to relational tables with Talend
I am trying to import data from MongoDB to a relational DB (SQL Server).
I don't have access to the MongoDB components so I am querying my collection with the mongo java driver, in a tJava component.
...
- 396
1
vote
1
answer
648
views
parse JSON to MongoDB inTalend
I am new in Talend and ask for help to more experienced.
I am trying to download data from a webservice RESTFul to a MongoDB database, but the original JSON format received doesn't allow the direct ...
- 722
0
votes
1
answer
844
views
Talend Parallelization and Java Scope
I am creating a job to create a complex multi level document for mongoDB from relational data.
I read 'product' records in from Oracle.
I have a tJavaRow and I use the mongoDB API to create a ...
- 3,022
0
votes
2
answers
785
views
MongoDB date import via Talend from Oracle is out by 1 day
I am actually using the mongDB API via a tLibraryLoad component, as I find this easier to build complex multi-level documents using tJavaRow and tJava components, than using the MongoDB palette ...
- 3,022
0
votes
1
answer
58
views
Transaction - Querying database management
Could someone give me advices about managing transaction-querying in relational database. Concretely, I have a Oracle database with 10000k records (1TB). In context of a job ETL (Talend), I have to ...
- 1,079
0
votes
1
answer
526
views
talend open studio to extract different csv to mongodb
I have couple of csv file, all of my csv files are about to identical but some columns in csv file are differ from one another. As an example:
csv 1,2,3 have these columns:
id name post title cdate ...
- 325