span8
span4
span8
span4
For the moment I used a CSV reader to get my features from the CSV file and then used a Database joiner with join on the ID both in my table (primary key) and in the CSV.The cardinality is set to "1:1".
This way I get in the port the features with no match in the database table.
I'm not sure it is the fastest way (takes more than 50 sec to perform the join - ~400 000 lines in the table).Would it be more efficient to have all the ID's in a list and filter with this list ?
I am a little bit lost how to do it efficiently.Any idea would be appreciated.
It probably would be faster to have the list of ID's in a CSV file and then just use another CSV reader.
FME can read CSV super fast (like lightning fast) - and if you use the FeatureJoiner (not FeatureMerger) with the list of ID's and your original CSV you should see a very fast workflow.Just be sure you're using 2018+ to get the speed benefits (see this article on Bulk Mode:https://knowledge.safe.com/questions/49482/what-transformers-have-feature-table-technology-fo.html).
If instead you want to keep using the DB joiner you could try using a Prefetch Query in the DatabaseJoiner
'SELECT id from
This could speed up your current process but I think having them in a list would be much faster if this doesn't create too much overhead.I'm no database pro so others might have better ideas.
Up to 10 attachments (including images) can be used with a maximum of 4.0 MB each and 4.0 MB total.
Working with automatically assigned IDs from a Database4 Answers
Parse CSV data stored in database table2 Answers
MySQL date/time field2 Answers
SHP to Oracle Database5 Answers
Create a database with FME?2 Answers
© 2020 Safe Software Inc |Legal