Talk:AI-Assisted Road Tracing

From OpenStreetMap Wiki
Jump to: navigation, search

Why we changed our title for this wiki

Changed from “AI-Based Country Scale Road Import” to “AI- Assisted Road Tracing”

Since posting this wiki we have received quite a bit of feedback from the forums, e-mail and conversations with long time OSM contributors. Based on this feedback we have decided to go back and make some changes to help clarify a few things.

  • While using AI has become common practice in the tech world, it is fairly new to OSM and there aren't any guides to adhere to so we decided to call it an import. However we wanted to clarify that we have created a process that is basically like remote tracing using satellite imagery, where most of our roads are generated using deep learning.
  • It is important to note we are creating the data ourselves, processing it and then following the same process you normally would when using a Tasking Manager to edit with iD or JOSM.
  • Multiple people go through each node and way making sure to tag each road appropriately, connect them to current OSM edits, fix alignment when necessary, add sensible changeset comments/notes and resolve conflicts before finally saving where it is merged with the current OSM data.
  • We are working with just one country at a time and our edits will happen slowly by grouping areas into small regions so we complete one before moving to the next. We plan to spend the next few months in Thailand.
  • Here is an example of how we plan to divide the tasks for the country. The colors indicate the current density of roads going from blue to red for high density areas. Thailand Road Density by Task
  • As promised we will also be sharing sample data to the import list.

Who is "We"

Please state who "we" is supposed to be in this page in an intro, some more context would be good too. SimonPoole (talk) 21:54, 16 February 2017 (UTC)

Now, a month later it is still not disclosed what account names are used for the import. Does Facebook want to play hide and seek? --Stephankn (talk) 23:00, 20 March 2017 (UTC)

usernames had been hidden inside links. Expanded them so search will return them. --Stephankn (talk) 06:48, 21 March 2017 (UTC)

Discussion with the community

It's worth mentioning that there is an active OSM forum for Thailand at https://forum.openstreetmap.org/viewforum.php?id=46 , and at the very least I'd expect any import of "detected" roads in that area to be discussed with them before it takes place. Personally I'm somewhat sceptical that "we have been able to train models accurate enough to detect roads from satellite imagery", since the evidence so far suggests that you absolutely have not been able to do that (see https://forum.openstreetmap.org/viewtopic.php?id=55685 et al). --SomeoneElse (talk) 00:01, 17 February 2017 (UTC)

The consultation with the community should probably not happen with the local community first and imports@ second, but both at the same time, or perhaps iron out the basic issues on imports@ before proposing something to the local community that may not happen. Pnorman (talk) 11:27, 18 February 2017 (UTC)

Facebook Response

Hello Simon,

We really value feedback, so thank you for highlighting some points we needed to clarify. Please take a look at our edits to our original post. To clarify further, we are not directly uploading machine generated roads; it's AI-assisted human mapping and we have conducted extensive training with our mappers to make sure each edit is validated by multiple different people to ensure quality.

We've been communicating via email over the past 4 months with specific local users in Thailand to gather feedback and local knowledge and to share our initial results. There are a number of people behind this email osm@fb.com, and we invite all feedback and questions. —Preceding unsigned comment added by DrishT (talkcontribs) 17:21, 17 February 2017

Yes, but the last one was supposed to be AI-assisted mapping. It's not clear to me that you've established where the last one went wrong and what measures there are to ensure it won't happen again. p.s., it helps if you sign your posts with four ~ so people can tell who's written what. Pnorman (talk) 11:13, 18 February 2017 (UTC)

Since our last upload we have improved our process based on community feedback. We're now working with a larger team of highly-trained mappers and have added steps to the validation process. We're confident this round will be much smoother! Again, we welcome your suggestions at osm@fb.com. We have a dedicated team behind the email who will respond within 24 hours. --DrishT (talk) 17:38, 18 February 2017 (UTC)

Changeset tags

The proposed changeset tags are comment=#nsroadimport #country, which do not follow the practice of using Good Changeset Comments Pnorman (talk) 11:29, 18 February 2017 (UTC)

Thank you, Paul. We provided these comments so community members could easily see our edits. Each mapper will provide more detailed comments as they edit following this guide: Good Changeset Comments--DrishT (talk) 17:36, 18 February 2017 (UTC)

Lack of discussion

This page was created on the 14 February and claimed that

Following the imports guidelines, these imports will be discussed first in the country specific mailing list, and to get more feedback it will also be shared with the import list.

Yet, 2 days later and without any discussion on the imports list OR the Thailand user forum, someone proceeded to import data in Thailand: https://www.openstreetmap.org/user/VLD004/history I'm very sorry to see that this continues the "bad faith" track record from last time with its lack of transparency (how hard can it be to put a note in the user profile explaining who they are and who they are working for) and a blatant disregard for the community (you promise to discuss things ahead and then break your own promise two days later). Is what we're seeing here just incompetence, or a deliberate attempt at misleading the community? You must have known, after things failed so badly last time, that more diligence is required in dealing with OSM. --Frederik Ramm (talk) 12:17, 24 February 2017 (UTC)

Hi Frederick, Prior to importing data, we shared proposed edits with Thailand OSM community members via email for feedback. Given your expertise and experience in OSM, we'd like to speak to you, and your OSM Data Working Group partners, in more detail about our approach and process. We're new to this community and want your direct feedback and suggestions. Can you please share some days and times over the next couple of weeks that work for your group? We'll set up a meeting via VC if we're unable to all be in the same place. Thanks again, Drish --DrishT (talk) 01:27, 25 February 2017 (UTC)
You can and should email the imports mailing list? That's a good place to speak to relevant people. If you're new to OSM, perhaps you shouldn't start with an import. Maybe start with regular OSM contribution, and when you have learned the ropes, you can do an import, which is a more advanced action Rorym (talk) 14:55, 25 February 2017 (UTC)
(to Xgao3006) - thank you for updating the wiki page, but you do need to follow the import guidelines, which does include (as Rory says) that you should email the imports mailing list. --SomeoneElse (talk) 23:28, 27 February 2017 (UTC)
Hi Andy, thank you for the feedback. Yes, we are aware about posting to the import list and will do so before making any edits.