Questions in topic: "data transformation" https://knowledge.亚搏在线safe.com/questions/topics/single/20674.html The latest questions for the topic "data transformation" retrieve data from form xls but not columnar https://knowledge.亚搏在线safe.com/questions/85157/retrieve-data-from-form-xls-but-not-columnar.html

I have a standardized xls form that does not use columns.It is designed as a field form and has all cells locked except where the field personnel are to put data.This is more like an OCR type of conversion than excel.all the values I need are in specific (sometimes merged) cells.So there is not a column which contains a value.

I am able to retrieve all the data and can see it all in inspector just not format I need.

Each file is a separate event.Each sheet is a separate feature.The data for each feature is always in the same cells.我需要连续输出每个特性。I have attached an image showing 1 sheet.

excel data transformation form Thu,10 Jan 2019 16:47:45 GMT kidsmake6until2
GEDCOM and FTM File Format Data Transformations https://knowledge.亚搏在线safe.com/idea/73387/gedcom-and-ftm-file-format-data-transformations.html

As an amateur genealogist for over 45 years,I currently use Family Tree Maker to record my data.I have used others overthe years and exported the data out as a GEDCOM to send to others withdifferent software.That seems to be the universal language of the variousgenealogy programs.I've often thought that it would be helpful to be able totransfer the data to other formats,even just Excel,and have more control over what parts of the data I use so that I can manipulateit in other ways (for example using the location coordinates to map in Arc).

data transformation file formats Thu,28 Jun 2018 16:06:10 GMT beckyfinley
Populate entire column based on specific value in the same column https://knowledge.亚搏在线safe.com/questions/67313/populate-entire-column-based-on-specific-value-in.html

Is there an easy way to populate an entire column (I have multiple columns) based on the value in that column that has a comma in it?

基本上,if I have a column named pole and all attributes in that column have the value of "pole_status" except for one value that has this value: "Con,PLA,MRC,MRE".How can I populate the entire column with "Con,PLA,MRC,MRE".

I've tried Attribute Manager using a Conditional Value to filter out all records that don't have comma in it but then I'm not sure how I can actually use the "Con,PLA,MRC,MRE" value as the output value.Maybe there's a better option.Custom Python might do the trick - but I want to exhaust all of my transformer options before I go that route.Note: I cant simply write "Con,PLA,MRC,MRE" in the AttributeManager since these values will change and there's multiple columns - si it wouldn't be sustainable

I also know I can probably accomplish this by using a multiple FeatureMergers but I definitely don't want to do that (if I dont have to) due to performance (there would probably be 20 + FeatureMergers).

Thanks!

attributemanager data transformation manipulation Mon,02 Apr 2018 16:57:41 GMT davidbailey
Key Value Row Groupings https://knowledge.亚搏在线safe.com/questions/56191/key-value-row-groupings.html

I'm having some trouble assembling a record set in the way I want to assemble it.

I currently have features structured like the following

Attribute A Attribute B Attribute C
GroupValue1 Key Value
GroupValue1 Key2 Value
GroupValue1 Key3 Value
GroupValue2 Key Value
GroupValue2 Key2 Value
GroupValue2 Key3 Value

Where each row is a feature (except the first in this case,which are attribute names).

What I would like is to create a new feature grouping on Attribute A,with Attribute B holding attribute names for this new feature and Attribute C holding the value of those attributes.I've looked into attribute pivoter and aggregator to accomplish this;but I can't seem to figure out how to pull this off.Any ideas on what I'm missing?In my data,I can guarantee the uniqueness of Attribute B across unique values of Attribute A.

Maybe what I'm asking for isn't possible.I'm not sure.

aggregator data transformation pivot Fri,20 Oct 2017 15:05:01 GMT aarongundel
What are your Tips and Tricks for Anonymizing Data? https://knowledge.亚搏在线safe.com/questions/52535/what-are-your-tips-and-tricks-for-anonymizing-data.html

While working with customers and sensitive data,we on the 亚搏在线Safe Software Support Team often run into road blocks troubleshooting issues when FME Workspaces and source data cannot be shared (nor can an NDA be arranged in a timely manner – and for this argument,neither can a screen share be arranged).

There is an excellentKnowledge Center articlethat takes a real world example,and provides a tutorial with many actions the user can take to anonymize sensitive data.

Particularly the following techniques are used:

- Removing Attributes (AttributeRemover,AttributeManager)
- Renaming Attributes (AttributeRenamer,AttributeManager)
- Replacing Attribute Values (AttributeManager,StringReplacer)
- Geographic Manipulation (CenterPointReplacer,Offsetter)


What actions do you take,or what do you think is missing from this list?Are there any custom transformers that could help?

And is it possible that a custom transformer could becreatedto aid in automation of this practice?

Looking forward to any input or comments that you provide!Thank you.

[ keywords : anonymous data random values randomization scramble scrambling ]

data transformation random values Thu,07 Sep 2017 19:01:19 GMT rylanat亚搏在线safe
Row of data with hwy and mp.i want to find unique hwy min(mp) and max(mp) and create a single row. https://knowledge.亚搏在线safe.com/questions/50447/row-of-data-with-hwy-and-mp-i-want-to-find-unique.html

I have a set of data that contains on each row a highway,start_mp.I want to find,for each highway,the min(start_mp) and the max_start_mp and combine them into a single row of data ordered like: HWY,MIN(START_MP),MAX(START_MP),other attributes.

data transformation Fri,11 Aug 2017 21:20:32 GMT jonlibby
When X found in table A and B,insert Y from B into A https://knowledge.亚搏在线safe.com/questions/41199/for-all-instances-where-same-number-in-table-a-fie.html

I have two shapefiles,A and B:

A includes the object id (Field TLNUMERO) and data fields for a long list of TLNUMERO objects.Each TLNUMERO can be listed on many rows,as data about different angles around the object is found on different rows.

B includes among others the same objects (their id also specified by field TLNUMERO) but otherwise other data / fields.Each TLNUMERO is listed only on one row.

I want FME to insert the data from two fields (say xxx and yyy) from the row with a specific TLNUMERO in table B into the rows with the same TLNUMERO in table A.

merge data transformation Sun,12 Mar 2017 17:07:28 GMT benjamin
copy an attribute from one record with another.Where the another reference is the same value https://knowledge.亚搏在线safe.com/questions/40900/copy-an-attribute-from-one-record-with-another-whe.html

I have a table of data below which I need to copy the property number to the null fields in the other records for that uprn?Any ideas?

data transformation Mon,06 Mar 2017 16:47:38 GMT rdcagale
fme data types and esri data types https://knowledge.亚搏在线safe.com/questions/40255/fme-data-types-and-esri-data-types.html

Dear all,

I Have a schema mapper transformer that is defined based on an external oracle table

The external table have a column_name destination_attribute_type where I defined the data type of the file to be translated.

Is there any specific reason why "fme_int32" of the oracle table is not converted to "long integer"

For the shape files,the field data type of "fme_int32" yields to a data type "double" with length equal to11.

Thanks

data transformation Mon,20 Feb 2017 14:51:54 GMT arthy
Newbie question about simplifying CSV data https://knowledge.亚搏在线safe.com/questions/36493/newbie-question-about-simplifying-csv-data.html

Hello everyone,

I am a newbie trying to learn FME on my own for work and am having trouble with what is probably very simple data structuring...I've been trying to figure this out but can't find an example that is similar to what I'm trying to do,so I'm desperate for help!

I have data in a CSV file...columns contain values for each state that correspond to a date (month).The first column contains the list of states.It looks like this...

original-data.png

The ultimate goal is to format this data so that I can put it into ArcGIS and display the values for each state over time...I've been able to do this in a test with a subset of the data by manually reformatting the data to look like this..

state-data.png

I need to have a date attribute so that I can loop the values in ArcGIS,so I can't just combine the date and state in one attribute.

Basically I need to know how to reformat the original CSV data in FME so that there is a feature for each state and month and an attribute with the corresponding value for that state and month.I've tried bulk attribute renamer,attribute creator,aggregater...but I just end up with the same format with all the dates in the columns.

Any help including any resources with examples on how to handle excel/csv data is greatly appreciated!

excel csv data transformation Tue,15 Nov 2016 01:57:35 GMT weathersfuori
Update geometry attribute from Excel to XML https://knowledge.亚搏在线safe.com/questions/35968/update-geometry-attribute-from-excel-to-xml.html

I have the some features and its coordinates in excel file and have an XML with the same features.I need to update the coordinates from excel to XML.Please suggest me the transformers and the process to update the geometry coordinates from excel to XML.I have point and linear features also.Please suggest.Thanks in advance.

data transformation Sun,30 Oct 2016 05:40:47 GMT chagantisasikir
Create a "function group" to run on separated data sets https://knowledge.亚搏在线safe.com/questions/35529/create-a-function-group-to-run-on-separated-data-s.html

I have linear spatial data that consists of types (A,B,C,...J,K) as well as condition (1,2,3,4,5).I am tasked with creating a list of total length of each type split by condition,ie Length of A1 = 100m,Length of A2 = 30m,...Length of K5 = 200m.

Is there a way I can create a function that splits the input into condition and then measures it without grouping all the output data?Currently I am splitting the data into types,then splitting each type into condition,then performing measurements,which results in dozens of identical functions being run.It seems that this can be streamlined,but I am somewhat new to FME and I am unsure how to approach this.

I'm currently exporting the resulting data into excel,if that helps.

Thanks in advance!

excel batch processing group by data transformation Wed,19 Oct 2016 21:56:12 GMT mitchellorchard
Read CSV-File -> Offset & Rotate -> Writte to CSV File https://knowledge.亚搏在线safe.com/questions/35361/read-csv-file-offset-rotate-writte-to-csv-file.html

Hi all

I thought I have a simple task - but I wasn't able to do it!I have a csv-list with points and would like to add an offset and rotate these points (Helmert Transformation) and write it afterwords back to a csv-file.But my transformation (rotation and offset) is ignored somehow.

Is there more to do than open the csv file,set the x/y/z_coordinate data type and the coordinate system and simply add the rotation and offseter Transformer?

It would be great if someone could give me a hint!

Thanks in advanced

csv data transformation rotator Mon,17 Oct 2016 15:13:00 GMT dominikeichenla
cleaning GPS line work https://knowledge.亚搏在线safe.com/questions/31926/cleaning-gps-line-work.html

Hello

I am trying to clean up some GPS line work before it is loaded into our database.THe lines need to be free of self intersections.I have come close to accomplishing this by buffering the line and then using the centreline replacer to create a smoothed line.The problem is that the centreline replacer is creating short dangles along the length of the line.The actual centreline it is creating is good enough for my purposes I just need to remove the dangles.If anyone has any ideas on how to do this it would be much appreciated.

In this screen shot the Green line is the original line with self intersections and the red line is the result of the centreline replacer.

data qa data transformation gps Wed,03 Aug 2016 18:50:47 GMT mapper
Solving Quartic Functions in FME https://knowledge.亚搏在线safe.com/idea/31085/solving-quartic-functions-in-fme.html

From personal experience,it could potentially be useful to offer a transformer that can be used to solve for various mathematical functions (e.g.mathematical functions to degree 2,3,4,...,to degreen).

attribute handling 变形金刚 data interoperability data transformation Fri,15 Jul 2016 17:09:37 GMT je6thoma