Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
### NITIIndiaPopulationProjection Import

- Description: Population projection at India country and state level. Country level data is aggregated from state level through pvmap. The dataset are about total population project at state level and total urban population projection at state level whcih are extended to country level as well.

- Source URL: https://ndap.niti.gov.in/dataset/7208, https://ndap.niti.gov.in/dataset/7209

- Import Type: Manual Refresh

- Data Availability: 2011 to 2026

- Release Frequency: P1Y

### Preprocessing and Data Acquisition

To download the raw input files:

- Click on the provided source url. Login credentials are required to download the data. Create an account if not already created else login and download the data for both the dataset.


### Data Processing

After the files are downloaded, the data is processed using the stat_var_processor.py script. The script uses various command-line arguments to specify the input data, pvmap, configuration file, and output path for each category.

* India State Population

```bash

python3 stat_var_processor.py --existing_statvar_mcf=gs://unresolved_mcf/scripts/statvar/stat_vars.mcf --input_data='{Path to downloaded input state population file}' --pv_map='../../statvar_imports/india_ndap/india_state_population_pvmap.csv' --config_file='../../statvar_imports/india_ndap/india_state_population_metadata.csv' --output_path='../../statvar_imports/india_ndap/output/india_state_population'

```

* India State UrbanPopulation

```bash

python3 stat_var_processor.py --existing_statvar_mcf=gs://unresolved_mcf/scripts/statvar/stat_vars.mcf --input_data='{Path to downloaded input state urban population file}' --pv_map='../../statvar_imports/india_ndap/india_state_urban_population_pvmap.csv' --config_file='../../statvar_imports/india_ndap/india_state_urban_population_metadata.csv' --output_path='../../statvar_imports/india_ndap/output/india_state_urban_population'
```
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
parameter,value
header_rows,1
output_columns,"observationDate,observationAbout,variableMeasured,value,unit,measurementMethod,observationPeriod"
multi_value_properties,"gender, observationAbout"
Original file line number Diff line number Diff line change
@@ -0,0 +1,68 @@
key,prop,value,,,,,,,,,,
State,observationAbout,{Data},,,,,,,,,,
Female,gender,Female,gender,"""""",,,,,,,,
Male,gender,Male,gender,"""""",,,,,,,,
Comment thread
saanikaaa marked this conversation as resolved.
"Projected Population (UOM:Number), Scaling Factor:1000",populationType,Person,measuredProperty,count,value,{Number},#Multiply,1000,measurementMethod,NITIIndiaProjection,#Aggregate,sum
"Calendar Year (Jan - Dec), 2036",observationDate,2036,#ignore,skip,,,,,,,,
"Calendar Year (Jan - Dec), 2035",observationDate,2035,#ignore,skip,,,,,,,,
"Calendar Year (Jan - Dec), 2034",observationDate,2034,#ignore,skip,,,,,,,,
"Calendar Year (Jan - Dec), 2033",observationDate,2033,#ignore,skip,,,,,,,,
"Calendar Year (Jan - Dec), 2032",observationDate,2032,#ignore,skip,,,,,,,,
"Calendar Year (Jan - Dec), 2031",observationDate,2031,#ignore,skip,,,,,,,,
"Calendar Year (Jan - Dec), 2030",observationDate,2030,#ignore,skip,,,,,,,,
"Calendar Year (Jan - Dec), 2029",observationDate,2029,#ignore,skip,,,,,,,,
"Calendar Year (Jan - Dec), 2028",observationDate,2028,#ignore,skip,,,,,,,,
"Calendar Year (Jan - Dec), 2027",observationDate,2027,#ignore,skip,,,,,,,,
"Calendar Year (Jan - Dec), 2026",observationDate,2026,,,,,,,,,,
"Calendar Year (Jan - Dec), 2025",observationDate,2025,,,,,,,,,,
"Calendar Year (Jan - Dec), 2024",observationDate,2024,,,,,,,,,,
"Calendar Year (Jan - Dec), 2023",observationDate,2023,,,,,,,,,,
"Calendar Year (Jan - Dec), 2022",observationDate,2022,,,,,,,,,,
"Calendar Year (Jan - Dec), 2021",observationDate,2021,,,,,,,,,,
"Calendar Year (Jan - Dec), 2020",observationDate,2020,,,,,,,,,,
"Calendar Year (Jan - Dec), 2019",observationDate,2019,,,,,,,,,,
"Calendar Year (Jan - Dec), 2018",observationDate,2018,,,,,,,,,,
"Calendar Year (Jan - Dec), 2017",observationDate,2017,,,,,,,,,,
"Calendar Year (Jan - Dec), 2016",observationDate,2016,,,,,,,,,,
"Calendar Year (Jan - Dec), 2015",observationDate,2015,,,,,,,,,,
"Calendar Year (Jan - Dec), 2014",observationDate,2014,,,,,,,,,,
"Calendar Year (Jan - Dec), 2013",observationDate,2013,,,,,,,,,,
"Calendar Year (Jan - Dec), 2012",observationDate,2012,,,,,,,,,,
"Calendar Year (Jan - Dec), 2011",observationDate,2011,,,,,,,,,,
State,observationAbout,country/IND,,,,,,,,,,
Andaman And Nicobar Islands,observationAbout,wikidataId/Q40888,,,,,,,,,,
Andhra Pradesh,observationAbout,wikidataId/Q1159,,,,,,,,,,
Arunachal Pradesh,observationAbout,wikidataId/Q1162,,,,,,,,,,
Assam,observationAbout,wikidataId/Q1164,,,,,,,,,,
Bihar,observationAbout,wikidataId/Q1165,,,,,,,,,,
Chandigarh,observationAbout,wikidataId/Q120971341,,,,,,,,,,
Chhattisgarh,observationAbout,wikidataId/Q1168,,,,,,,,,,
Delhi,observationAbout,wikidataId/Q1353,,,,,,,,,,
Goa,observationAbout,wikidataId/Q1171,,,,,,,,,,
Gujarat,observationAbout,wikidataId/Q1061,,,,,,,,,,
Haryana,observationAbout,wikidataId/Q1174,,,,,,,,,,
Himachal Pradesh,observationAbout,wikidataId/Q1177,,,,,,,,,,
Jammu And Kashmir,observationAbout,wikidataId/Q66278313,,,,,,,,,,
Jharkhand,observationAbout,wikidataId/Q1184,,,,,,,,,,
Karnataka,observationAbout,wikidataId/Q1185,,,,,,,,,,
Kerala,observationAbout,wikidataId/Q1186,,,,,,,,,,
Ladakh,observationAbout,wikidataId/Q200667,,,,,,,,,,
Lakshadweep,observationAbout,wikidataId/Q26927,,,,,,,,,,
Madhya Pradesh,observationAbout,wikidataId/Q1188,,,,,,,,,,
Maharashtra,observationAbout,wikidataId/Q1191,,,,,,,,,,
Manipur,observationAbout,wikidataId/Q1193,,,,,,,,,,
Meghalaya,observationAbout,wikidataId/Q1195,,,,,,,,,,
Mizoram,observationAbout,wikidataId/Q1502,,,,,,,,,,
Nagaland,observationAbout,wikidataId/Q1599,,,,,,,,,,
Odisha,observationAbout,wikidataId/Q22048,,,,,,,,,,
Puducherry,observationAbout,wikidataId/Q66743,,,,,,,,,,
Punjab,observationAbout,wikidataId/Q22424,,,,,,,,,,
Rajasthan,observationAbout,wikidataId/Q1437,,,,,,,,,,
Sikkim,observationAbout,wikidataId/Q1505,,,,,,,,,,
Tamil Nadu,observationAbout,wikidataId/Q1445,,,,,,,,,,
Telangana,observationAbout,wikidataId/Q677037,,,,,,,,,,
The Dadra And Nagar Haveli And Daman And Diu,observationAbout,wikidataId/Q77997266,,,,,,,,,,
Tripura,observationAbout,wikidataId/Q1363,,,,,,,,,,
Uttar Pradesh,observationAbout,wikidataId/Q1498,,,,,,,,,,
Uttarakhand,observationAbout,wikidataId/Q1499,,,,,,,,,,
West Bengal,observationAbout,wikidataId/Q1356,,,,,,,,,,
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
parameter,value
header_rows,1
output_columns,"observationDate,observationAbout,variableMeasured,value,unit,measurementMethod,observationPeriod"
multi_value_properties,"gender, observationAbout"
Original file line number Diff line number Diff line change
@@ -0,0 +1,68 @@
key,prop,value,,,,,,,,,,
State,observationAbout,{Data},,,,,,,,,,
Female,gender,Female,gender,"""""",,,,,,,,
Male,gender,Male,gender,"""""",,,,,,,,
Comment thread
saanikaaa marked this conversation as resolved.
"Projected Urban Population (UOM:Number), Scaling Factor:1000",populationType,Person,measuredProperty,count,placeOfResidenceClassification,Urban,value,{Number},#Multiply,1000,measurementMethod,NITIIndiaProjection,#Aggregate,sum,,,
"Calendar Year (Jan - Dec), 2036",observationDate,2036,#ignore,skip,,,,,,,,
"Calendar Year (Jan - Dec), 2035",observationDate,2035,#ignore,skip,,,,,,,,,,
"Calendar Year (Jan - Dec), 2034",observationDate,2034,#ignore,skip,,,,,,,,,,
"Calendar Year (Jan - Dec), 2033",observationDate,2033,#ignore,skip,,,,,,,,,,
"Calendar Year (Jan - Dec), 2032",observationDate,2032,#ignore,skip,,,,,,,,,,
"Calendar Year (Jan - Dec), 2031",observationDate,2031,#ignore,skip,,,,,,,,,,
"Calendar Year (Jan - Dec), 2030",observationDate,2030,#ignore,skip,,,,,,,,,,
"Calendar Year (Jan - Dec), 2029",observationDate,2029,#ignore,skip,,,,,,,,,,
"Calendar Year (Jan - Dec), 2028",observationDate,2028,#ignore,skip,,,,,,,,,,
"Calendar Year (Jan - Dec), 2027",observationDate,2027,#ignore,skip,,,,,,,,,,
Comment thread
saanikaaa marked this conversation as resolved.
"Calendar Year (Jan - Dec), 2026",observationDate,2026,,,,,,,,,,
"Calendar Year (Jan - Dec), 2025",observationDate,2025,,,,,,,,,,
"Calendar Year (Jan - Dec), 2024",observationDate,2024,,,,,,,,,,
"Calendar Year (Jan - Dec), 2023",observationDate,2023,,,,,,,,,,
"Calendar Year (Jan - Dec), 2022",observationDate,2022,,,,,,,,,,
"Calendar Year (Jan - Dec), 2021",observationDate,2021,,,,,,,,,,
"Calendar Year (Jan - Dec), 2020",observationDate,2020,,,,,,,,,,
"Calendar Year (Jan - Dec), 2019",observationDate,2019,,,,,,,,,,
"Calendar Year (Jan - Dec), 2018",observationDate,2018,,,,,,,,,,
"Calendar Year (Jan - Dec), 2017",observationDate,2017,,,,,,,,,,
"Calendar Year (Jan - Dec), 2016",observationDate,2016,,,,,,,,,,
"Calendar Year (Jan - Dec), 2015",observationDate,2015,,,,,,,,,,
"Calendar Year (Jan - Dec), 2014",observationDate,2014,,,,,,,,,,
"Calendar Year (Jan - Dec), 2013",observationDate,2013,,,,,,,,,,
"Calendar Year (Jan - Dec), 2012",observationDate,2012,,,,,,,,,,
"Calendar Year (Jan - Dec), 2011",observationDate,2011,,,,,,,,,,
State,observationAbout,country/IND,,,,,,,,,,
Andaman And Nicobar Islands,observationAbout,wikidataId/Q40888,,,,,,,,,,
Andhra Pradesh,observationAbout,wikidataId/Q1159,,,,,,,,,,
Arunachal Pradesh,observationAbout,wikidataId/Q1162,,,,,,,,,,
Assam,observationAbout,wikidataId/Q1164,,,,,,,,,,
Bihar,observationAbout,wikidataId/Q1165,,,,,,,,,,
Chandigarh,observationAbout,wikidataId/Q120971341,,,,,,,,,,
Chhattisgarh,observationAbout,wikidataId/Q1168,,,,,,,,,,
Delhi,observationAbout,wikidataId/Q1353,,,,,,,,,,
Goa,observationAbout,wikidataId/Q1171,,,,,,,,,,
Gujarat,observationAbout,wikidataId/Q1061,,,,,,,,,,
Haryana,observationAbout,wikidataId/Q1174,,,,,,,,,,
Himachal Pradesh,observationAbout,wikidataId/Q1177,,,,,,,,,,
Jammu And Kashmir,observationAbout,wikidataId/Q66278313,,,,,,,,,,
Jharkhand,observationAbout,wikidataId/Q1184,,,,,,,,,,
Karnataka,observationAbout,wikidataId/Q1185,,,,,,,,,,
Kerala,observationAbout,wikidataId/Q1186,,,,,,,,,,
Ladakh,observationAbout,wikidataId/Q200667,,,,,,,,,,
Lakshadweep,observationAbout,wikidataId/Q26927,,,,,,,,,,
Madhya Pradesh,observationAbout,wikidataId/Q1188,,,,,,,,,,
Maharashtra,observationAbout,wikidataId/Q1191,,,,,,,,,,
Manipur,observationAbout,wikidataId/Q1193,,,,,,,,,,
Meghalaya,observationAbout,wikidataId/Q1195,,,,,,,,,,
Mizoram,observationAbout,wikidataId/Q1502,,,,,,,,,,
Nagaland,observationAbout,wikidataId/Q1599,,,,,,,,,,
Odisha,observationAbout,wikidataId/Q22048,,,,,,,,,,
Puducherry,observationAbout,wikidataId/Q66743,,,,,,,,,,
Punjab,observationAbout,wikidataId/Q22424,,,,,,,,,,
Rajasthan,observationAbout,wikidataId/Q1437,,,,,,,,,,
Sikkim,observationAbout,wikidataId/Q1505,,,,,,,,,,
Tamil Nadu,observationAbout,wikidataId/Q1445,,,,,,,,,,
Telangana,observationAbout,wikidataId/Q677037,,,,,,,,,,
The Dadra And Nagar Haveli And Daman And Diu,observationAbout,wikidataId/Q77997266,,,,,,,,,,
Tripura,observationAbout,wikidataId/Q1363,,,,,,,,,,
Uttar Pradesh,observationAbout,wikidataId/Q1498,,,,,,,,,,
Uttarakhand,observationAbout,wikidataId/Q1499,,,,,,,,,,
West Bengal,observationAbout,wikidataId/Q1356,,,,,,,,,,
Original file line number Diff line number Diff line change
@@ -0,0 +1,73 @@
Country,State,Year,Gender,"Projected Population (UOM:Number), Scaling Factor:1000"
India,Andaman And Nicobar Islands,"Calendar Year (Jan - Dec), 2026",Female,193
India,Andaman And Nicobar Islands,"Calendar Year (Jan - Dec), 2026",Male,214
India,Andhra Pradesh,"Calendar Year (Jan - Dec), 2026",Female,26906
India,Andhra Pradesh,"Calendar Year (Jan - Dec), 2026",Male,26857
India,Arunachal Pradesh,"Calendar Year (Jan - Dec), 2026",Female,784
India,Arunachal Pradesh,"Calendar Year (Jan - Dec), 2026",Male,827
India,Assam,"Calendar Year (Jan - Dec), 2026",Female,18145
India,Assam,"Calendar Year (Jan - Dec), 2026",Male,18744
India,Bihar,"Calendar Year (Jan - Dec), 2026",Female,64131
India,Bihar,"Calendar Year (Jan - Dec), 2026",Male,69158
India,Chandigarh,"Calendar Year (Jan - Dec), 2026",Female,589
India,Chandigarh,"Calendar Year (Jan - Dec), 2026",Male,684
India,Chhattisgarh,"Calendar Year (Jan - Dec), 2026",Female,15648
India,Chhattisgarh,"Calendar Year (Jan - Dec), 2026",Male,15739
India,Delhi,"Calendar Year (Jan - Dec), 2026",Female,10687
India,Delhi,"Calendar Year (Jan - Dec), 2026",Male,12088
India,Goa,"Calendar Year (Jan - Dec), 2026",Female,797
India,Goa,"Calendar Year (Jan - Dec), 2026",Male,806
India,Gujarat,"Calendar Year (Jan - Dec), 2026",Female,35365
India,Gujarat,"Calendar Year (Jan - Dec), 2026",Male,39170
India,Haryana,"Calendar Year (Jan - Dec), 2026",Female,14869
India,Haryana,"Calendar Year (Jan - Dec), 2026",Male,16623
India,Himachal Pradesh,"Calendar Year (Jan - Dec), 2026",Female,3745
India,Himachal Pradesh,"Calendar Year (Jan - Dec), 2026",Male,3850
India,Jammu And Kashmir,"Calendar Year (Jan - Dec), 2026",Female,6669
India,Jammu And Kashmir,"Calendar Year (Jan - Dec), 2026",Male,7281
India,Jharkhand,"Calendar Year (Jan - Dec), 2026",Female,20159
India,Jharkhand,"Calendar Year (Jan - Dec), 2026",Male,21061
India,Karnataka,"Calendar Year (Jan - Dec), 2026",Female,34072
India,Karnataka,"Calendar Year (Jan - Dec), 2026",Male,35087
India,Kerala,"Calendar Year (Jan - Dec), 2026",Female,18840
India,Kerala,"Calendar Year (Jan - Dec), 2026",Male,17423
India,Ladakh,"Calendar Year (Jan - Dec), 2026",Female,135
India,Ladakh,"Calendar Year (Jan - Dec), 2026",Male,171
India,Lakshadweep,"Calendar Year (Jan - Dec), 2026",Female,34
India,Lakshadweep,"Calendar Year (Jan - Dec), 2026",Male,36
India,Madhya Pradesh,"Calendar Year (Jan - Dec), 2026",Female,43778
India,Madhya Pradesh,"Calendar Year (Jan - Dec), 2026",Male,46406
India,Maharashtra,"Calendar Year (Jan - Dec), 2026",Female,62244
India,Maharashtra,"Calendar Year (Jan - Dec), 2026",Male,67548
India,Manipur,"Calendar Year (Jan - Dec), 2026",Female,1659
India,Manipur,"Calendar Year (Jan - Dec), 2026",Male,1666
India,Meghalaya,"Calendar Year (Jan - Dec), 2026",Female,1726
India,Meghalaya,"Calendar Year (Jan - Dec), 2026",Male,1728
India,Mizoram,"Calendar Year (Jan - Dec), 2026",Female,634
India,Mizoram,"Calendar Year (Jan - Dec), 2026",Male,643
India,Nagaland,"Calendar Year (Jan - Dec), 2026",Female,1116
India,Nagaland,"Calendar Year (Jan - Dec), 2026",Male,1187
India,Odisha,"Calendar Year (Jan - Dec), 2026",Female,23525
India,Odisha,"Calendar Year (Jan - Dec), 2026",Male,23752
India,Puducherry,"Calendar Year (Jan - Dec), 2026",Female,942
India,Puducherry,"Calendar Year (Jan - Dec), 2026",Male,839
India,Punjab,"Calendar Year (Jan - Dec), 2026",Female,14942
India,Punjab,"Calendar Year (Jan - Dec), 2026",Male,16466
India,Rajasthan,"Calendar Year (Jan - Dec), 2026",Female,41071
India,Rajasthan,"Calendar Year (Jan - Dec), 2026",Male,42985
India,Sikkim,"Calendar Year (Jan - Dec), 2026",Female,336
India,Sikkim,"Calendar Year (Jan - Dec), 2026",Male,374
India,Tamil Nadu,"Calendar Year (Jan - Dec), 2026",Female,38934
India,Tamil Nadu,"Calendar Year (Jan - Dec), 2026",Male,38675
India,Telangana,"Calendar Year (Jan - Dec), 2026",Female,19251
India,Telangana,"Calendar Year (Jan - Dec), 2026",Male,19442
India,The Dadra And Nagar Haveli And Daman And Diu,"Calendar Year (Jan - Dec), 2026",Female,514
India,The Dadra And Nagar Haveli And Daman And Diu,"Calendar Year (Jan - Dec), 2026",Male,1117
India,Tripura,"Calendar Year (Jan - Dec), 2026",Female,2106
India,Tripura,"Calendar Year (Jan - Dec), 2026",Male,2171
India,Uttar Pradesh,"Calendar Year (Jan - Dec), 2026",Female,117075
India,Uttar Pradesh,"Calendar Year (Jan - Dec), 2026",Male,126846
India,Uttarakhand,"Calendar Year (Jan - Dec), 2026",Female,5870
India,Uttarakhand,"Calendar Year (Jan - Dec), 2026",Male,6184
India,West Bengal,"Calendar Year (Jan - Dec), 2026",Female,49454
India,West Bengal,"Calendar Year (Jan - Dec), 2026",Male,51259
Loading
Loading