The Lipad Blog

Dataset Updates (1.0.2)

The following updates have been made to the Lipad dataset; the new version is available for download on the Data page.

  • Addition of 'subsubtopic' field to the basehansard table: Additional topic information (typically during Oral Question Period) has been added to the database.
  • Missing data for a small number of dates in 2016 was added to the database ('2016-10-21', '2016-09-20').
  • Member data added for Glen Motz (new member via byelection in October 2016)
  • Addition of 'pid_fk_id' (Foreign Key on member) to constituency table
  • Introduction of version numbering (retroactive to previous update in October 2016)

Continue Reading

Dataset Changelog

1.0.2 (January 23, 2017):

  • Addition of 'subsubtopic' field to the basehansard table: Additional topic information (typically during Oral Question Period) has been added to the database.
  • Missing data for a small number of dates in 2016 was added to the database ('2016-10-21', '2016-09-20').
  • Member data added for Glen Motz (new member via byelection in October 2016)
  • Addition of 'pid_fk_id' (Foreign Key on member) to constituency table
  • Introduction of version numbering (retroactive to previous update in October 2016)

1.0.1 (October 25, 2016):

  • Approximately 80,000 speeches over the mid-1990s and early 2000s were not properly linked with their ParlINFO file and member information
  • Approximately 300 members across the dataset were missing select positions in their parliamentary career file
  • Downloading month-by-month .csv data exports has been replaced by a complete file of the Lipad dataset in a series of daily .csv files. This new package is available on ...

Continue Reading

Tutorial: Opening the Lipad Dataset in PostgreSQL

If you are familiar with basic SQL but have never used PostgreSQL, the following tutorial will help you get started querying the Lipad dataset. It covers installation of PostgreSQL on a Windows machine, importation of the Lipad dataset, and basic querying in pgAdmin3 (the graphical interface for PostgreSQL).

A. Installation

1) Download the PostgreSQL 9.6.1 visual installer, available at https://www.bigsql.org/postgresql/installers.jsp

2) Run the installer. First, the Setup Wizard will ask you to select the installation directory; leave this as default and click Next to proceed.

install1

3) On the Select Components screen, un-check BigSQL Manager II and check pgAdmin3 LTS as shown in the diagram.

install2

4) The next screen selects the location for database storage; leave this as default and proceed.

5) The Password screen asks you to provide a password for the default database user, "postgres". Select a password you will remember ...

Continue Reading

Server Changes

As of today (November 30, 2016), lipad.ca has transitioned to a new web host.

Permalinks to speeches that took place in the House between November 15-30 2016 may have shifted during the move. All Hansards dated prior to November 15, 2016, are unaffected by the move.

If you encounter any technical issues on the new server, please let us know!

Continue Reading

Dataset Updates October 2016

The Lipad dataset has been updated to fix some errors and omissions discovered over the past few months. The following is a summary of important changes:

  • Approximately 80,000 speeches over the mid-1990s and early 2000s were not properly linked with their ParlINFO file and member information
  • Approximately 300 members across the dataset were missing select positions in their parliamentary career file
  • Downloading month-by-month .csv data exports has been replaced by a complete file of the Lipad dataset in a series of daily .csv files. This new package is available on the Data page of the site.

We suggest all users of an offline copy of the dataset re-download source files from the Data page.

Continue Reading

Welcome to Lipad!

This blog entry marks the first public release of the lipad.ca website! Our goal is to provide both a friendly and accessible new way for Canadians to access information about Canada's parliament, and a truly open data resource for scholars interested in the Canadian Hansard dataset. We'll be using this research blog to highlight ongoing analysis work by members of the Lipad team, discuss research results, and present new website features and supplementary datasets as they come online.

Continue Reading

What About the French Version? Qu'en est-il de la version française?

Digitizing the French version of the Hansard is a priority for our research team. Unfortunately, we are not able to release it at this time. The creation of a digitized textual database such as Dilipad requires many hours of work and is conducted entirely by academics and students. In particular, the optical recognition of special and accentuated characters in French would require adjusting the parameters of our source code and completing a testing phase in order to produce a digitized version of sufficient quality. We hope to complete this task as soon as possible and release the full version of the Hansard in both official languages. The creation of a bilingual database matters to us. It would give Canadians an easier access to parliamentary debates and would be a useful resource for applied research in natural language processing, for instance in the development of translation tools.

La numérisation de la ...

Continue Reading

About The Lipad Blog

The latest updates, analysis, and research notes from the Lipad team.