{"id":6901,"date":"2018-11-08T02:16:24","date_gmt":"2018-11-08T01:16:24","guid":{"rendered":"http:\/\/www.sigterritoires.fr\/?p=6901"},"modified":"2023-07-14T10:23:29","modified_gmt":"2023-07-14T08:23:29","slug":"geometry-validation-tools-3-fme","status":"publish","type":"post","link":"https:\/\/www.sigterritoires.fr\/index.php\/en\/geometry-validation-tools-3-fme\/","title":{"rendered":"Geometry validation tools (3): FME"},"content":{"rendered":"\n

After discussing the ArcMap tool ( GIS tools for validating geometries (1)<\/a> ) and the\ntools Spatialite \/ PostGIS<\/a> ( GIS tools for validating geometries (2): Spatialite and\nPostGIS)<\/a> we will discuss the available tools when using FME software\n. The first two articles approached specific tools for a given format: ArcGis\nshape and geodatabases, Spatialite databases or Postgis. <\/p>\n\n\n\n

The FME tools, themselves, can process virtually all existing GIS formats.\n<\/p>\n\n\n\n

First, just for once, FME documents the validation process by listing\nthe anomalies it takes into account . You will find a document in English with\na presentation of two options for validation and quality control on the\nfollowing page http:\/\/cdn.safe.com\/resources\/technical-briefs\/Data_Validation_and_Quality_Assurance_with_FME.pdf\n
\nHere we use the corresponding table for the validation of the geometries, but translated\nin French. Since FME implements the GEOS definition, this table provides a\ncomprehension of the tests performed by the SQL queries in the Spatiality and\nPostgis databases of the previous article. <\/p>\n\n\n\n\n\n\n\n

The table presents the type of anomaly, the types of geometries where it\napplies (point, line or polygon) and a brief description of the anomaly. <\/p>\n\n\n\n

The last column contains one or many + signs . <\/p>\n\n\n\n

+++ Means that the detection and correction of this type of\nanomaly is easy with FME. In practice, this corresponds to the detected\nanomalies by the request ST_IsValid of Spatialite and Postgis and the\ntransformer GeometryValidator of FME. <\/p>\n\n\n\n

++ To detect and correct this type of anomaly, a particular\nconfiguration of the validation tools must be made. In practice, if you pass\nthe basic geometries of audit request, these anomalies will not appear. <\/p>\n\n\n\n

+ These anomalies require a particular work on the data (deconstruction\n\/ reconstruction) to be detected and corrected. The available tools cannot\ndetect them as they are . <\/p>\n\n\n\n

Display items Search : <\/p>\n\n\n\n

<\/td><\/tr>
\n 1<\/strong> \n <\/td>	\n Rear Loopings<\/strong> –<\/strong> auto-intersections<\/strong>\n \n <\/td>	\n Line<\/strong> ,<\/strong> Polygons<\/strong> \n <\/td>	\n Polygons<\/strong> \u201cbutterflies<\/strong>\u201d.<\/strong> \n <\/td>	\n ++<\/strong> \n <\/td><\/tr><\/thead>
\n 2 \n <\/td>	\n Polygons\n or open rings \n <\/td>	\n Polygons\n \n <\/td>	\n The\n starting and destination node of a polygon or ring are not the same. This implies\n that the entity cannot be closed. \n <\/td>	\n +++ \n <\/td><\/tr>
\n 3 \n <\/td>	\n Internal\n polygon with incorrect direction of rotation. \n <\/td>	\n Polygons\n \n <\/td>	\n The\n order of the nodes of the polygons external and internal polygons is defined.\n External polygons have to be clockwise, while internal polygons should be counter\n clockwise. \n <\/td>	\n ++ \n <\/td><\/tr>
\n 4 \n <\/td>	\n Duplicate\n points \n <\/td>	\n Point,\n Line, Polygons \n <\/td>	\n A point\n that has exactly the same X and Y as another point \n <\/td>	\n ++ \n <\/td><\/tr>
\n 5 \n <\/td>	\n Back tracking\n \n <\/td>	\n Line ,\n Polygons \n <\/td>	\n Error\n Scan causes an inconsistency in the construction of a line \n <\/td>	\n ++ \n <\/td><\/tr>
\n 6 \n <\/td>	\n Spades \n <\/td>	\n Line ,\n Polygons \n <\/td>	\n Similar\n to backtracking but caused by a point that departs abnormally of the line \n <\/td>	\n ++ \n <\/td><\/tr>
\n 7 \n <\/td>	\n Minimum\n area \n <\/td>	\n Polygons\n \n <\/td>	\n An entity\n surface must not have an area below a certain threshold \n <\/td>	\n +++ \n <\/td><\/tr>
\n 8 \n <\/td>	\n encroachments\n or empty \n <\/td>	\n Polygons\n \n <\/td>	\n Small or\n empty overlays between the edges of adjacent polygons\n <\/td>	\n ++ \n <\/td><\/tr>
\n 9 \n <\/td>	\n Overlay\n of polygons \n <\/td>	\n Polygons\n \n <\/td>	\n Major\n overlay of two polygons \n <\/td>	\n ++ \n <\/td><\/tr>
\n 10 \n <\/td>	\n polygons\n duplicated ( polygons with the same attributes ) \n <\/td>	\n Line ,\n Polygons \n <\/td>	\n Two polygons\n with the same geometry and exactly the same attributes \n <\/td>	\n +++ \n <\/td><\/tr>
\n 11 \n <\/td>	\n Short\n segments \n <\/td>	\n Line ,\n Polygons \n <\/td>	\n Very\n small distance between two nodes. This distance corresponds to the tolerance\n of the data set \n <\/td>	\n ++ \n <\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n Viewing\nitems 1 to 10 of 13 items <\/p>\n\n\n\n Previous\nNext <\/p>\n\n\n\n How<\/strong> does<\/strong> FME work?<\/strong> <\/p>\n\n\n\n To process the geometries we will use the FME Workbench 2015 program. \nThe interface offers a graphic window that allows building a processing model. \nThere are three types of elements in a processing model: Readers, Writers, and Transformers.\n\n\nReaders are modules that read GIS formats and\nmake them available for FME processing. FME reads and writes hundreds of GIS\nformats. The ArcGis Interoperability Data is provided by FME. \n\n\n\n<\/p>\n\n\n\n $\"\"$ <\/figure>\n\n\n\n \n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nTransformers\nare processing modules. They take the data provided by a Reader and produce\ndata for Writers. Therefore FME treatments can apply to any data format. \n\n\n\n<\/p>\n\n\n\n $\"\"$ <\/figure>\n\n\n\n \n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nWriters\nare modules that take the results of FME processing and write them in a given\nGIS format. \n\n\n\n<\/p>\n\n\n\n $\"\"$ <\/figure>\n\n\n\n Our processing model is simple: <\/p>\n\n\n\n \n A reader that points to our com2011.shp layer ( see previous articles ) <\/li>\n\n\n\n A transform that is GeometryValidator <\/li>\n\n\n\n Three \u00a0\u00a0 writers that hand over as output three shapefiles:\n \n one for all entities whose geometries show no anomaly: all2011passed <\/li>\n\n\n\n one for all entities with anomalies and have been repaired by transformer: all2011repaired <\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n \n\n\n\n\n\n\n\n\n\none for all entities with abnormalities but could not be repaired by\ntransformer: all2011failed \n\n\n\n<\/p>\n\n\n\n $\"\"$ <\/figure>\n\n\n\n \n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nBy clicking\nthe symbol \u201csetting\u201d of the GeometryValidator you open the settings window: \n\n\n\n<\/p>\n\n\n\n $\"\"$ <\/figure>\n\n\n\n This window allows enabling or disabling the verifications, and to\ndetermine the specific parameters to some of them. In our example, we select\nthem all. \n\nBy clicking the execute button, the processing\ntakes place in front of you. The final window is as follows:\n\n\n\n<\/p>\n\n\n\n $\"\"$ <\/figure>\n\n\n\n The Transformer has read 8094 entities in input, of which 8075 had no\nanomaly in their geometry while 19 had anomalies. These entities (communes)\nhave been written in output in the\nall2011repaired.shp file. \n\nIf we open the table of this last file: \n\n\n\n<\/p>\n\n\n\n $\"\"$ <\/figure>\n\n\n\n We find the 19 communes with geometry anomalies, the same detected by\nthe tests of the previous articles. <\/p>\n","protected":false},"excerpt":{"rendered":" After discussing the ArcMap tool ( GIS tools for validating geometries (1) ) and the tools Spatialite \/ PostGIS ( GIS tools for validating geometries (2): Spatialite and PostGIS) we will discuss the available tools when…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"give_campaign_id":0,"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"sfsi_plus_gutenberg_text_before_share":"","sfsi_plus_gutenberg_show_text_before_share":"","sfsi_plus_gutenberg_icon_type":"","sfsi_plus_gutenberg_icon_alignemt":"","sfsi_plus_gutenburg_max_per_row":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[1260],"tags":[],"class_list":["post-6901","post","type-post","status-publish","format-standard","hentry","category-non-classe-en"],"aioseo_notices":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p6XU0A-1Nj","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.sigterritoires.fr\/index.php\/wp-json\/wp\/v2\/posts\/6901","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.sigterritoires.fr\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.sigterritoires.fr\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.sigterritoires.fr\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.sigterritoires.fr\/index.php\/wp-json\/wp\/v2\/comments?post=6901"}],"version-history":[{"count":0,"href":"https:\/\/www.sigterritoires.fr\/index.php\/wp-json\/wp\/v2\/posts\/6901\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.sigterritoires.fr\/index.php\/wp-json\/wp\/v2\/media?parent=6901"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.sigterritoires.fr\/index.php\/wp-json\/wp\/v2\/categories?post=6901"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.sigterritoires.fr\/index.php\/wp-json\/wp\/v2\/tags?post=6901"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}