India AI-Assisted Road Tracing

From OpenStreetMap Wiki
Jump to navigation Jump to search

Goal

Facebook and RMSI are mapping roads in major cities throughout India. Facebook has been running a project to perform AI-Assisted Road Tracing within OpenStreetMap. Our goal is to collaborate with the OpenStreetMap community to create quality road data, validated by trained mappers and local OSM communities in India.

We are working together to map roads in major cities throughout the country. RMSI will be doing the bulk of the mapping work as we have local knowledge of the country along with Facebook teams assistance from time to time. For any queries please send questions to osm@fb.com or osm@rmsi.com.

For more information on the project please also check out Mapwith.ai and the github page Facebook OSM Data Team

Schedule

Planning: Second half of Feb’20. Our initial plan is to focus on 313 priority cities by mapping the cities which fall within the admin 3 areas.

List of Cities
Abohar Bhimavaram Gandhinagar Kaithal Nadiad Sambalpur
Adilabad Bhind Gaya Kakinada Nagercoil Sasaram
Adoni Bhiwandi Ghaziabad Kalol Nagpur Satara
Agartala Bhiwani Ghazipur Kalyan Naihati Satna
Agra Bhopal Godhra Kamarhati Nalgonda Sawai Madhopur
Aizawl Bhubaneswar Gonda Kanchipuram Nanded Seoni
Ajmer Bhuj Gondal Kanchrapara Nandurbar Shahjahanpur
Akola Bhusawal Gorakhpur Kanpur Nangloi Jat Shillong
Alandur Bidar Gudivada Kapra Navsari Shimla
Alappuzha Bijapur Gulbarga Karimnagar Neyveli Shimoga
Aligarh Bikaner Guna Karnal Nizamabad Sikar
Allahabad Bilaspur Guntakal Kashipur Ongole Silchar
Alwar Botad Guntur Katihar Orai Sirsa
Ambala Budaun Gurgaon Khammam Palanpur Sitapur
Ambarnath Bulandshahr Gwalior Khandwa Pali Siwan
Amravati Burhanpur Hajipur Khanna Pallavaram Sonipat
Amritsar Champdani Haldia Kharagpur Palwal Srikakulam
Anand Chandausi Haldwani Khardaha Panihati Sultanpur
Anantapur Chandigarh Halisahar Kochi Panipat Surat
Ara Chandrapur Hanumangarh Kolar Panvel Surendranagar
Asansol Chennai Hapur Kolhapur Parbhani Tambaram
Aurangabad Chhapra Hardoi Kolkata Patan Tenali
Avadi Chhatarpur Haridwar Kollam Pathankot Thanesar
Azamgarh Chhindwara Hassan Korba Patiala Thanjavur
Badlapur Chikmagalur Hathras Kota Patna Thiruvananthapuram
Bagaha Chittaurgarh Hazaribag Kulti Phagwara Thrissur
Bahadurgarh Damoh Hisar Kumbakonam Pilibhit Tiruchirappalli
Bahraich Darbhanga Hoshangabad Lakhimpur Pondicherry Tirunelveli
Baidyabati Dehra Dun Hoshiarpur Lalitpur Porbandar Tirupati
Balurghat Dehri Hospet Latur Proddatur Tiruvannamalai
Banda Delhi Hosur Loni Pudukkottai Tiruvottiyur
Bangalore Deoria Hubli Ludhiana Pune Titagarh
Bangaon Dewas Hyderabad Machilipatnam Puri Tonk
Bankura Dhanbad Ichalkaranji Madanapalle Purnia Tumkur
Baranagar Dharmavaram Imphal Madhyamgram Rae Bareli Udgir
Barasat Dhule Indore Madurai Raichur Udupi
Barddhaman Dibrugarh Itarsi Mahbubnagar Raiganj Ujjain
Barnala Dimapur Jabalpur Malegaon Raigarh Ulhasnagar
Barsi Dindigul Jagadhri Malerkotla Raipur Vadodara
Basirhat Durg Jaipur Mandsaur Rajkot Varanasi
Batala Durgapur Jalandhar Mandya Rampur Vejalpur
Beawar Eluru Jalna Mathura Ranchi Veraval
Begusarai Erode Jalpaiguri Mirzapur Raniganj Vidisha
Belgaum Etah Jamnagar Moga Ratlam Vijayawada
Bellary Etawah Jamshedpur Moradabad Rewa Virar
Bettiah Faizabad Jamuria Morena Rewari Visakhapatnam
Bhadreswar Faridabad Jaunpur Mormugao Rishra Vizianagaram
Bhagalpur Farrukhabad Jhansi Motihari Robertsonpet Warangal
Bharuch Firozabad Jhunjhunun Mumbai Rohtak Wardha
Bhavnagar Firozpur Jind Munger Sagar Yamunanagar
Bhilai Gadag Jodhpur Muzaffarnagar Saharanpur Yavatmal
Bhilwara Gandhidham Junagadh Muzaffarpur Saharsa


Project Start Dates: Starts at the end of February 2020.

Announcement: https://lists.openstreetmap.org/pipermail/talk-in/2020-February/003349.html

Data Processing

The road extraction in India will be performed same as mentioned in “Facebook AI-Assisted Road Tracing

Submission Process

The submission process consists of the following steps summarized in the image below.


  1. We use the OSM Tasking manager to divide up tasks and create a flow of editing and validation for the Facebook mapping team.
  2. The Mapper picks a task into our enhanced version of iD (RapiD) which includes both the roads generated by us and the current OSM data.
  3. The Mapper evaluates the roads we generated (styled in a different color) and inspect them for issues like crossing highways, disconnected roads, incorrect intersections, short road stubs, road types, etc., and fixes these issues manually one by one, using Maxar satellite imagery.
    ID paintstyle distinguish AI Assistance generated roads with magenta color.jpg
  4. iD is equipped with data validation functionalities similar to JOSM and osmlint. This allows us to check for quality and conflicts with current OSM data prior to submission. Some examples of what we check for include:
    • Isolated roads that are not connected to the rest of the map.
    • Roads crossing waterways.
    • Roads with repeating node IDs.
    • Roads with possible connections after a short extension.
    • Self-intersecting ways.
  5. In case of conflicts between our newly added roads and other OSM contributors' changes, our mappers will almost always choose “keep their edits.” If we end up changing another mapper's edits, (for example, to align better with the latest version of DG satellite imagery) we will leave detailed notes to explain why.
  6. After fixing all the issues detected in the RapiD tool, the Mapper saves the data to the OSM.
  7. A Validator then goes into the same task to verify that the data looks correct by re-validating the data, makes necessary changes as needed and then conducts a post-submission review of the submitted edits in JOSM. If any errors are detected, the validator addresses the errors and submits necessary changes. Some examples for what we check for include:
    • Short Unclassified ways (between 10-60 meters)
    • Highway crossing waterway without a bridge tag
    • Highway crossing buildings
    • Overlapping ways
    • Unspecific highway tags
    • Stub end
  8. A custom JOSM paint style is used to help distinguish our submissions from community submissions, so that all roads with the source=digitalglobe tag are highlighted in green.
  9. We will continue to watch all comments made on our edits, reply to them in a timely fashion. We are happy to incorporate feedback and local expertise into our validation process and future mapping behaviors.


Data Preparation

Road Type Tagging

During the submission process, our mappers will assign and fix road types according to the India highway tag guidelines of OSM India/Tags/Highway.

Some other methods we use to tag roads include:

  • Looking at commonly used tags in the local area of mapping.
  • When connecting to current OSM roads on the map we try to use the same tag where it makes sense to do so.
    Referring to the local community for advice.


Changeset Tags

We use the following tags:

Changeset Tags: comment = '#mapwithai #India’

Element Tags:

  • Current format: source = maxar
  • Before September , 2020
  • source = digitalglobe

The 'source' tag indicates that road geometries are based on Maxar satellite imagery.


Data Merge Workflow

Team Approach

This import (data integration) will be done through a Tasking Manager, by engineers and a group of selected trained map editors. Among the skills required:

  • Good experience with iD and JOSM.
  • Familiarity with editing norms: how to merge nodes (M), join ways (J), combine ways (C) and un-gluing (G)
  • He / She knows how to handle conflicts with both iD tools and JOSM.

Mappers:

Name Username Role Link
Chandana Sirasala VLD110 Validator https://www.openstreetmap.org/user/VLD110
Madhukar Rayagiri VLD262 Validator https://www.openstreetmap.org/user/VLD262
Ashok VLD139 Validator https://www.openstreetmap.org/user/VLD139
G Venkateswar Reddy VLD126 Validator https://www.openstreetmap.org/user/VLD126
Narendar Reddy P VLD109 Mapper https://www.openstreetmap.org/user/VLD109
Regu Venkatesham VLD116 Mapper https://www.openstreetmap.org/user/VLD116
Samba Shiva Rao.Punna VLD117 Mapper https://www.openstreetmap.org/user/VLD117
D Kumar Reddy VLD120 Mapper https://www.openstreetmap.org/user/VLD120
Sainath Reddy Jammula VLD133 Validator https://www.openstreetmap.org/user/VLD133
Hema Sindhu Meka VLD135 Mapper https://www.openstreetmap.org/user/VLD135
Venkata Himabindu B VLD136 Validator https://www.openstreetmap.org/user/VLD136
K Charan VLD140 Mapper https://www.openstreetmap.org/user/VLD140
Harish Moigari VLD103 Mapper https://www.openstreetmap.org/user/VLD103
Soundarya Thangapally VLD141 Validator https://www.openstreetmap.org/user/VLD141
Nashithuddin Mohammed VLD113 Mapper https://www.openstreetmap.org/user/VLD113
R Sravan VLD142 Mapper https://www.openstreetmap.org/user/VLD142
S Krishna Panchala VLD258 Mapper https://www.openstreetmap.org/user/VLD258
M Kumar VLD148 Mapper https://www.openstreetmap.org/user/VLD148
Md. Nurul Haque VLD257 Mapper https://www.openstreetmap.org/user/VLD257
Ajay Gupta VLD253 Mapper https://www.openstreetmap.org/user/VLD253
Neeraj Singh VLD256 Mapper https://www.openstreetmap.org/user/VLD256
Kavita VLD250 Mapper https://www.openstreetmap.org/user/VLD250
Satendra kumar VLD147 Mapper https://www.openstreetmap.org/user/VLD147
Mahesh K VLD106 Mapper https://www.openstreetmap.org/user/VLD106
Mahesh VLD132 Mapper https://www.openstreetmap.org/user/VLD132
Kolluri Sanjeev Kumar VLD118 Mapper https://www.openstreetmap.org/user/VLD118
Devender Reddy VLD111 Mapper https://www.openstreetmap.org/user/VLD111
Vikas Kumar Sonu VLD260 Mapper https://www.openstreetmap.org/user/VLD260
Surendra Singh Nayal VLD149 Mapper https://www.openstreetmap.org/user/VLD149
Yashwanti VLD261 Mapper https://www.openstreetmap.org/user/VLD261
Shubham Yadav VLD254 Mapper https://www.openstreetmap.org/user/VLD254
Deepak Kumar VLD251 Mapper https://www.openstreetmap.org/user/VLD251
Naveen chavati VLD125 Mapper https://www.openstreetmap.org/user/VLD125
Lavu Gnana Teja VLD114 Mapper https://www.openstreetmap.org/user/VLD114
Gaurav Kumar VLD255 Mapper https://www.openstreetmap.org/user/VLD255
Kambalapally Naveen Reddy VLD252 Mapper https://www.openstreetmap.org/user/VLD252
Gumpili Sai Prashanth VLD143 Mapper https://www.openstreetmap.org/user/VLD143
Abdul wazid VLD144 Mapper https://www.openstreetmap.org/user/VLD144
Vishal Dubasi VLD145 Mapper https://www.openstreetmap.org/user/VLD145
Sujeet VLD259 Mapper https://www.openstreetmap.org/user/VLD259
V Iyer VLD263 Mapper https://www.openstreetmap.org/user/VLD263


Inactive users:

Name Username Role Link
NA NA NA NA


References:

Facebook AI-Assisted Road Tracing

Imports guidelines

In progress States

The status will be updated for every project City/Region completion.

S.No State / UT Region / City AI Assistant - Project Status Start Date Completed Date
1 Maharashtra Mumbai Completed 24-Feb-20 25-Apr-20
2 Tamil Nadu Dindigal Completed 8-Apr-20 13-May-20
3 Tamil Nadu Madurai Completed 8-Apr-20 12-May-20
4 Tamil Nadu Nagercoil Completed 1-May-20 15-May-20
5 Tamil Nadu Tirunelveli Completed 27-Apr-20 11-May-20
6 Kerala Alapuzha Completed 2-May-20 14-May-20
7 Kerala Chengannur and Thiruvalla Completed 5-May-20 26-May-20
8 Kerala Chathanoor & Kollam Completed 19-May-20 6-Jun-20
9 Kerala Thirssur Completed 8-May-20 8-Jun-20
10 Kerala Thiruvananthapuram Completed 6-May-20 4-Jun-20
11 Telangana Nalgonda Completed 11-May-20 22-Jun-20
12 Telangana Hyderabad Completed 16-May-20 22-Jun-20
13 Tamil Nadu Tiruchirappalli Completed 21-May-20 30-Jun-20
14 Puducherry Puducherry Completed 24-Jun-20 7-Jul-20
15 Tamil Nadu Tiruchengodu Completed 2-Jul-20 20-Jul-20
16 Tamil Nadu Kumbakonam Completed 14-Jul-20 20-Jul-20
17 Maharastra Jaysingpur Completed 11-Aug-20 18-Aug-20
18 Goa Panaji Completed 12-Aug-20 18-Aug-20
19 Karnataka Kolhapur Completed 17-Aug-20 26-Aug-20
20 Telangana Mahbubnagar Completed 18-Aug-20 31-Aug-20
21 Karnataka Belagavi Completed 24-Aug-20 31-Aug-20
22 Karnataka Gadag Completed 28-Aug-20 3-Sep-20
23 Karnataka Hubballi Completed 2-Sep-20 7-Sep-20
24 Andhra Pradesh Mantralayam Completed 24-Aug-20 7-Sep-20
25 Andhra Pradesh Vijayawada Completed 5-Sep-20 24-Sep-20
26 Andhra Pradesh Ongole Completed 3-Sep-20 9-Oct-20
27 Andhra Pradesh Guntur Completed 5-Sep-20 24-Sep-20
28 Andhra Pradesh Amaravathi Completed 5-Sep-20 25-Sep-20
29 Andhra Pradesh Machilipatnam Completed 5-Sep-20 24-Sep-20
30 Andhra Pradesh Bhimavaram Completed 6-Sep-20 24-Sep-20
31 Andhra Pradesh Kakinada Completed 18-Sep-20 30-Sep-20
32 Maharashtra Pune Completed 1-Oct-20 21-Oct-20
33 Maharashtra Satara Completed 21-Sep-20 21-Oct-20
34 Karnataka Vijayapura Completed 28-Sep-20 30-Oct-20
35 Maharashtra Solapur Completed 21-Oct-20 30-Oct-20
36 Maharashtra Latur Completed 19-Oct-20 5-Nov-20
37 Maharashtra Udgir Completed 12-Oct-20 30-Oct-20
38 Telangana Khammam Completed 6-Nov-20 24-Nov-20
39 Telangana Warangal Completed 22-Oct-20 30-Nov-20
40 Telangana Karimnagar Completed 22-Oct-20 30-Nov-20
41 Odisha Bhubaneshwar Completed 29-Oct-20 14-Nov-20
42 Andhra Pradesh Srikakulam Completed 19-Nov-20 12-Dec-20
43 Andhra Pradesh Vizianagaram Completed 6-Dec-20 17-Dec-20
44 Andhra Pradesh Visakhapatnam Completed 6-Dec-20 20-Dec-20
45 Chhattisgarh Korba Completed 15-Nov-20 5-Dec-20
46 Chhattisgarh Raigarh Completed 7-Dec-20 30-Dec-20
47 Odisha Sambalpur Completed 15-Dec-20 30-Dec-20
48 Chhattisgarh Bilaspur Completed 9-Dec-20 9-Jan-21
49 Chhattisgarh Bhilai Completed 9-Dec-20 30-Dec-20
50 Gujarat Junagadh Completed 20-Jan-21 30-Jan-21
51 Gujarat Rajkot & Gondal Completed 21-Jan-21 29-Jan-21
52 Gujarat Jamnagar Completed 30-Dec-20 21-Jan-21
53 Gujarat Bhuj Completed 21-Dec-20 18-Jan-21
54 Gujarat Palanpur Completed 6-Jan-21 10-Feb-21
55 Gujarat Gandhinagar Completed 1-Feb-21 23-Feb-21
56 Madhya Pradesh Mandsaur & Daloda Completed 6-Jan-21 17-Feb-21
57 Madhya Pradesh Ratlam Completed 27-Jan-21 10-Feb-21
58 Madhya Pradesh Indore Completed 2-Feb-21 5-Mar-21
59 Madhya Pradesh Dewas Completed 2-Feb-21 6-Mar-21
60 Madhya Pradesh Ujjain Completed 4-Feb-21 8-Mar-21
61 Rajasthan Bhilwara Completed 9-Feb-21 5-Mar-21
62 Rajasthan Begun Completed 6-Feb-21 20-Feb-21
63 Rajasthan Chittorgarh Completed 6-Feb-21 20-Feb-21
64 Rajasthan Kota Completed 22-Feb-21 4-Mar-21
65 Madhya Pradesh Guna Completed 11-Feb-21 25-Feb-21
66 Rajasthan Pali Completed 26-Feb-21 20-Mar-21
67 Rajasthan Jodhpur Completed 26-Feb-21 20-Mar-21
68 Rajasthan Jaipur Completed 24-Mar-21 7-Apr-21
69 Rajasthan Ajmer Completed 9-Mar-21 7-Apr-21
70 Rajasthan Tonk Completed 10-Mar-21 18-Mar-21
71 Rajasthan Sawai Madhopur Completed 18-Mar-21 25-Mar-21
72 Madhya Pradesh Seoni Completed 15-Mar-21 30-Mar-21
73 Madhya Pradesh Jabalpur Completed 24-Mar-21 28-Apr-21
74 Madhya Pradesh Jhansi Completed 26-Mar-21 20-May-21
75 Madhya Pradesh Chhatarpur Completed 7-Apr-21 23-May-21
76 Madhya Pradesh Rewa Completed 16-Apr-21 6-May-21
77 Madhya Pradesh Gwalior Completed 22-Apr-21 25-May-21
78 Rajasthan Jhunjhunu & Sikar Completed 18-May-21 30-May-21
79 Uttar Pradesh Orai Completed 1-May-21 20-May-21
80 Uttar Pradesh Banda Completed 25-May-21 10-Jun-21
81 Uttar Pradesh Prayagraj Completed 2-Jun-21 11-Jun-21
82 Uttar Pradesh Raebareli Completed 2-Jul-21 23-Jul-21
83 Uttar Pradesh Kanpur Completed 2-Jul-21 30-Jul-21
84 Uttar Pradesh Varanasi Completed 15-Jun-21 15-Jul-21
85 Uttar Pradesh Sultanpur Completed 14-Jul-21 7-Aug-21
86 Madhya Pradesh Bhind Completed 1-Jul-21 31-Jul-21
86 Uttar Pradesh Hardoi Completed 9-Jul-21 31-Jul-21
86 Uttar Pradesh Shahjahanpur Completed 29-Jul-21 17-Aug-21
86 Uttar Pradesh Lakhimpur Completed 6-Aug-21 25-Aug-21
86 Uttar Pradesh Mathura Completed 16-Aug-21 31-Aug-21
86 Rajasthan Alwar Completed 16-Aug-21 31-Aug-21
86 Rajasthan Bikaner Completed 24-Aug-21 20-Sep-21
86 Jharkhand Ranchi Completed 24-Sep-21 5-Oct-21
86 Jharkhand Hazaribagh Completed 4-Oct-21 30-Oct-21
87 Bihar Gaya Completed 23-Oct-21 5-Nov-21
88 Bihar Aurangabad Completed 4-Nov-21 14-Nov-21
89 Bihar Sasaram Completed 13-Nov-21 20-Nov-21
90 Bihar Arrah Completed 19-Nov-21 30-Nov-21
91 Bihar Chapra Completed 19-Nov-21 30-Nov-21
92 Bihar Patna Completed 1-Nov-21 15-Dec-21
93 Bihar Motihari , Raxaul Completed 1-Nov-21 15-Dec-21
94 Bihar Darbhanga,Saharsa Completed 1-Nov-21 15-Dec-21
95 Bihar Bhagalpur,Katihar Completed 15-Dec-21 30-Dec-21
96 Bihar Purnia Completed 30-Dec-21 20-Jan-22
97 Jharkhand Jamshedpur Completed 3-Jan-22 30-Jan-22
98 West Bengal Raiganj, Kharagpur,Chandrakona Completed 28-Dec-21 30-Mar-22
99 West Bengal Asansol, Kolkata, Burdwan Completed 23-Mar-22 18-Apr-22
100 West Bengal Jalpaiguri,Siliguri Completed 23-Mar-22 18-Apr-22
101 Meghalaya Shillong Completed 16-Apr-22 8-May-22
102 Tripura Agartala Completed 8-May-22 30-May-22
103 Manipur Imphal Completed 8-May-22 30-May-22
104 Nagaland Dimapur Completed 8-May-22 31-May-22
105 Assam Dibrugarh Completed 31-May-22 30-Jun-22
106 Mizoram Aizawl Completed 8-May-22 31-May-22
107 Assam Silchar Completed 15-May-22 30-Jun-22
108 Uttar Pradesh Aligarh, Khurja, Bulandshahr Completed 11-May-22 15-Jun-22
109 Haryana Faridabad Completed 11-May-22 30-Jun-22
110 Uttar Pradesh Ghaziabad Completed 11-May-22 30-Jun-22
111 Uttar Pradesh Noida,Greater Noida Completed 11-May-22 30-Jun-22
112 Haryana Gurugram, Rewari Completed 27-Jun-22 30-Jul-22
113 Uttar Pradesh Agra, Hathras Completed 18-Jul-22 5-Aug-22
114 Uttar Pradesh Firozabad, Etah Completed 18-Jul-22 5-Aug-22
115 Haryana Bhiwani,Rohtak,Jind Completed 8-Aug-22 25-Aug-22
116 Haryana Hisar, Sirsa Completed 25-Aug-22 10-Sep-22
117 Rajasthan Hanumangarh Completed 8-Sep-22 18-Sep-22
118 Uttarakhand Dehradun Completed 15-Sep-22 30-Sep-22
119 Uttar Pradesh Saharanpur Completed 15-Sep-22 30-Sep-22
120 Haryana Kaithal Completed 28-Sep-22 6-Oct-22
121 Haryana Panipat, Karnal Completed 6-Oct-22 13-Oct-22
122 Punjab Patiala,Chandigarh Completed 12-Oct-22 20-Oct-22
123 Haryana Yamunanagar, Thanesar Completed 18-Oct-22 25-Oct-22
124 Uttar Pradesh Muzaffarnagar Completed 24-Oct-22 15-Nov-22
125 Himachal Pradesh Shimla Completed 24-Oct-22 15-Nov-22
126 Punjab Abohar Completed 24-Oct-22 15-Nov-22
127 Punjab Barnala,Ludhiana,Malerkotla Completed 12-Nov-22 25-Nov-22
128 Punjab Ludhiana,Jalandhar,Hoshiarpur Completed 25-Nov-22 5-Dec-22
129 Punjab Pathankot, Amritsar Completed 3-Dec-22 15-Dec-22
130 Jammu and Kashmir Srinagar,Jammu Completed 20-Dec-22 30-Dec-22
131 Punjab Firozpur Completed 22-Dec-22 30-Dec-22
132 Punjab Moga Completed 22-Dec-22 30-Dec-22
133 Assam Tinsukia Completed 2-Jan-23 8-Jan-23
134 Assam Jorhat Completed 7-Jan-23 17-Jan-23
135 Assam Bokajan Completed 17-Jan-23 23-Jan-23
136 Manipur Imphal Completed 17-Jan-23 23-Jan-23
137 Assam Hailakandi Completed 20-Jan-23 30-Jan-23
138 Mizoram Dapchhuah Completed 20-Jan-23 30-Jan-23
139 Tripura Bishramganj Completed 20-Jan-23 30-Jan-23
140 West Bengal Malda Completed 1-Feb-23 10-Feb-23
141 Bihar Bihpur Completed 1-Feb-23 10-Feb-23
142 West Bengal Bolpur,Berhampore Completed 7-Feb-23 14-Feb-23
143 Assam Guwahati Completed 9-Feb-23 14-Feb-23

QA

There will be 4 steps for the validation process done by experienced OSM editors including local country Mappers.

  • Mapper Validate the data before submitting the Data in RapiD.
  • Validator re-validate the data.
  • Validator also checks the data in JOSM.
  • Post validation with complete project.