..tools, techniques, research for public affairs reporting
  • About
  • Contact
Our Tools:
  • TimeFlow
  • Video Notebook
  • Haystax

Main menu

Skip to primary content
Skip to secondary content
  • News
  • Reviews
  • Developer challenges
  • Research Opportunities
  • Archives
A Duke University Project
 

Category Archives: Tools

Posts on tools that are already available to reporters, usually for free. Some are hard to use and we’ll work to make them easier. In the meantime, we’ll write about what they do and let you decide.

Reporters' Lab Managing Editor Tyler Dukes and Ryan Thornburg, an online journalism professor at UNC-Chapel Hill, listen in on a demo of DocHive by developer Edward Duncan in the offices of the Raleigh Public Record in early September 2012.
Tools

Turning scanned docs into structured data

Guest Posts//January 14, 2013

A new open-source program from the Raleigh Public Record aims to pull structured data from scanned public records — and developers are still looking for testing help from journalists and open-government advocates. Read More »

Tagged Charles Duncan // DocHive // ImageMagick // nicar // OCR // open source // Raleigh Public Record
Handwritten records can be tricky for humans to read -- and near impossible for computers.
Tools

To decipher handwriting, enlist a few enthusiasts

Tyler Dukes//October 2, 2012

Handwriting can seriously derail computer-assisted reporting. But an open-source tool developed to help archivists transcribe handwritten records with the help of online volunteers might pull double duty for journalists. Read More »

Tagged Ben Brumfield // crowdsourcing // FromThePage // handwriting // history // Mark Benjamin // Salon
Photo courtesy Alberto Paroni via stock.xchng
Tools

Archiving tweets isn’t as easy as it seems

Charlie Szymanski//August 7, 2012

Between deleted tweets and posts that disappear into the timeline void, it’s a pain to keep track of and find information more than a few days old on Twitter. So how hard could it really be to build a capable Twitter archiver for reporters? Read More »

Tagged API // database // social media // Twitter
Granicus' interface allows users to jump to sections of the video outlined by the government agency's meeting agenda. May agencies also include closed captioning.
Tools

Adding structure to unsearchable video

Tyler Dukes//May 15, 2012

The growth of online video is explosive, and without tools to navigate this unsearchable information, it’s increasingly impossible to make sense of it all. But there are a few novel solutions, especially when it comes to video from local, state and federal government. Read More »

Tagged Granicus // Javier Muniz // Liam Dillon // Tom Spengler // video // Voice of San Diego // Waldo Jaquith
Mining for relationships between pairs of variables in large databases can take time -- and statistical expertise.
Tools

‘Hypothesis generator’ helps mine big data

Tyler Dukes//April 12, 2012

An application created through a collaboration with Harvard and MIT could soon help journalists find interesting relationships in massive amounts of data — even if reporters have no idea what they’re looking for. Read More »

Tagged data // Harvard // MINE // MIT // Science // statistics
The Chicago Tribune's Brian Boyer removes his costume panda head before demonstrating PANDA, an open-source database system developed by Investigative Reporters and Editors.
Tools

How a conference taught me I know nothing

Tyler Dukes//February 28, 2012

The 2012 Computer-Assisted Reporting conference in St. Louis provided journalists with plenty of new reporting tools. Here’s our top-15 list of applications and websites from the weekend. Read More »

Tagged computer-assisted reporting // data // documents // nicar // Tools
| Image courtesy of Jo Naylor
Tools

Needlebase and the future of Web scraping tools

Tyler Dukes//February 10, 2012

The popular Web scraper Needlebase is getting put out to pasture. Why is it so hard to find and keep a good, easy-to-use scraper that doesn’t cost a fortune? And what’s left in the race to make it easier to collect info online? Read More »

Tagged Google // Needlebase // scraping
voyeurtools-easley
Tools

What’s in your document?

Sarah Cohen//May 4, 2011

I wonder about my judgment when I decide to try out a tool called Voyeur (http://voyeurtools.org) as one of the first on this site. But it’s worth a look from reporters who need a quick orientation to a website, a set of documents or a long report. Read More »

Tagged Text // Tools
this fixes an annoying IE7 bug. Our Mission Latest Reporters' Lab Review Get our source code on GitHub

Sidebar Social Networking

RSS Latest Reviews

  • Outwit Hub Pro can scrape almost any database, but learning curve steepens with complex datasets
  • Pdftotext excels at extracting data from conventional tables, stumbles with more complex tasks
  • For Monarch, high cost translates to unmatched spreadsheet conversion

Recent Posts

  • Tabula’s creator talks next steps
  • PolitiFact editor Bill Adair named Duke Knight chair
  • For watchdog stories, ‘who pays?’ is the wrong question

REPORTERS' LAB

A project of Duke University's Sanford School of Public Policy
Box 90241 // SB 140 //201 Science Drive //Durham, NC 27708-0241
info@reporterslab.org

Questions? Comments?

Email Tyler Dukes at tyler@reporterslab.org or call 919-613-7346

© 2012 Reporters' Lab. All Rights Reserved. // Web design by Row Design Studios

More Information

Our Mission
Reviews// Source Code
Developers Challenges// Research Topics

Duke University
Powered by WordPress

Testing

Testing