DataMeet-Up in Delhi, Friday 12th April

With the recently held Open Data Camp 2013 in Bangalore and the upcoming #12thPlan hackathon being organised by Planning Commission et al, the time seems right to organise a gathering of data enthusiasts in Delhi.

The DataMeet gatherings started in Bangalore in mid-2011 initially as periodic meet-ups, which slowly became a wider loose network of data enthusiasts in Bangalore and elsewhere, eventually leading up to Open Data Camps and data visualisation workshops.

Please let me invite you to a DataMeet gathering to be held in Sarai, CSDS, Civil Lines, Delhi on Friday, 12th April at 5 pm. The purpose of this gathering is to meet fellow (government and non-government) data enthusiasts in Delhi, share challenges and opportunities, and beginning discussions around future projects and initiatives. We hope to have a good mix of researchers, programmers, activists and advocates.

RSVP: If you are joining us for the DataMeet-Up, please let us know at mail[at]ajantriks.net.

Location: The map below shows the location of Sarai. The closest metro station is Civil Lines (on the Yellow Line), located at the other end of the Underhill Road. Let us know if you need any further details regrading reaching CSDS or other things.

loading map - please wait...

Sarai, Centre for the Study of Developing Societies, New Delhi 28.678258, 77.218137 Sarai Centre for the Study of Developing Societies #29 Rajpur Road

Photo Gallery Open Data Camp 2013 – Day 1

Pictures from Day 1 of OpenDataCamp 2013. There are about 400 of them taken by Meera Sankar. I have purposely not filtered any pictures. Its the complete set. You can use them as you like as long as the usage follows Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License. Please credit Meera Sankar.
Continue reading Photo Gallery Open Data Camp 2013 – Day 1

DataMeet Events and Major Links

Major Links this week!

Projects

Mentions of Open Data

Events:

Questions of the week

I was wondering whether there exists a mapping of PIN Codes to MP/MLA/Corporator constituencies/wards, please? Also, if a similar mapping exists to districts/taluks etc.?  – vis Gautam John

Data.Gov.In Beta is Up

Data.gov.in just launched its beta version. With 13 datasets already online and downloadable it is a good start. Granted not everything is working smoothly but given how new it is I’m feeling pretty good about the effort.

Like all things everywhere it never really is about intentions or really first steps but implementation and continued support. This is where the difficultly will lie with the Indian Government’s IT department the National Informatics Centre. They will be running the site and implementing the portal and I hope also can be an intermediary between citizens and the ministries that are providing the data.

Unlike data.gov or data.gov.uk, the data does not have to stay on data.gov.in, according the governing policy the National Data Sharing and Accessibility Policy. The individual Ministry has control of the data and can still charge, not make data downloadable, and also restrict data and not tell you why. Also incredibly valuable datasets like the Census and the National Sample Survey (official link not working) will not be available for download.
Continue reading Data.Gov.In Beta is Up

Reflections of Chennai’s Data Workshop from India Water Portal

Cross Posted from India Water Portal

Written by Aarti Kelkar-Khambete

This workshop organised by Transparent Chennai at The Institute of Financial Management and Research, Chennai was the outcome of the experiences of the earlier open data camp events organised by Transperant Chennai in Bangalore and Hyderabad, where there was a wide discussion among attendees who were excited by the potential of
data and the open data movement, but who did not have the necessary skills or technical background to work effectively with it.
It was felt that there was a much larger community of activists, researchers, and on-profits who could benefit from learning to use the kinds of tools presented at the camps. Thus, this event was planned differently from a data camp and focused on training activists, researchers and students to work with data where participants would learn about open data, data visualisation, spatial data and practical issues that come up when working with data in various forms.

The workshop thus aimed at helping the participants to:

  • Understand various formats of data, diverse possibilities of data visualisation and effective tools for doing so, with a special focus on web-based tools
  • Understand how to think through projects involving collection, processing and visualisation of data
  • Develop a basic understanding of software packages and methods for visualising quantitative data, creating geo-visualisation and undertaking participatory mapping
  • Understand the connection between data technologies and rights to access and use data.

Read the rest of the summary here.

Data Science meets Data Technology

Data Science meets Data Technology
The Big Picture
August 18th, 2012
10:00 AM – 12:30 PM
Conference Room 2
NIAS, Bangalore

While data is increasingly important in academia as well as in industry, the two worlds do not intersect each other all that often. DSDT is a monthly forum for sharing ideas about data across disciplines and industries. Each DSDT meeting will consist of two talks on a common theme, pairing a data scientist with a data technologist along with time for discussion. From the second session onward, we will have a tutorial and hacking session after the talks where we will learn how to work on understanding and analysing data sets relevant to that meeting’s theme. The schedule for the first meeting on the 18th at NIAS is given below.

10:00 AM – 10:30 AM: Tea
10:30 AM – 11:00 AM: Analysis: The Big Picture. Rajesh Kasturirangan, NIAS.
11:00 AM – 11:15 AM: Discussion of talk 1.
11:15 AM – 11:45 AM: Data and Visualization: The Big Picture. S. Anand, Gramener.
11:45 AM – Noon. Discussion of talk 2.
Noon – 12:30 PM: General Discussion.
For more information, visit http://analysis.knofu.org/

Scrapathon 1: Rajasthan Rain Water Data

Cross Posted from Rajasthan Rainfall Data (1957 to 2011) by Thejesh GN

The Rajashtan rainfall data was scraped as part of Scrapathon held in Bangalore 21st July 2011. Intially I used scraperwiki, but the huge amount of data made it to timeout all the time 🙂 so I wrote a simple python script to do it.

Data is in the SQLITE file data.sqlite, in a table called rainfall. It has 6,61,459 rows.
Columns: DISTRICT, STATION, YEAR, MONTH, DAY, RAIN_FALL, PAGE_ID

PAGE_ID refers to the ID in the table webpages which lists the webpages from where these data where scraped. It will help you incase you want to cross check. The rest of the columns are self explanatory. I have signed the SQLITE database using my GPG keys and the signatures are inside the file data_gpg_signature.sig

You can download my public key from any keyserver or from biglumber.

You can download here as of now. I will try to make it available on torrent later.

PIN code mapping

Where: Skype ID: datameet

Agenda:

Summary:

  • We’ll go for bulk geo-coding as opposed to crowd-sourcing
  • We’ll bulk source addresses. Please add any other sources you can think of
  • The Postal College’s list of post offices
  • Branch lists from banks such as SBI, or organisations like BSNL
  • Telephone directories
  • We’ll run them through Yahoo’s Placefinder, which is liberal in API limits and in licensing
  • We’ll create Voronoi treemaps out of those (ideally as OpenStreetMap XML files)

Linked mentioned during the meet:

DataMeet is a community of Data Science and Open Data enthusiasts.