Article Categories
» Arts & Entertainment
» Automotive
» Business
» Careers & Jobs
» Education & Reference
» Finance
» Food & Drink
» Health & Fitness
» Home & Family
» Internet & Online Businesses
» Miscellaneous
» Self Improvement
» Shopping
» Society & News
» Sports & Recreation
» Technology
» Travel & Leisure
» Writing & Speaking

  Listed Article

  Category: Articles » Business » Article
 

PDF Scraping: Making Modern File Formats More Accessible




By Joe Broderick

Data scraping is the process of automatically sorting through information contained on the internet inside html, pdf or other documents and collecting relevent information to into databases and spreadsheets for later retrieval. On most websites, the text is easily and accessibly written in the source code but an increasing number of buisnesses are using Adobe PDF format (Portable Document Format: A format which can be viewed by the free Adobe Acrobat software on almost any operating system). The advantage of PDF format is that the document looks exactly the same no matter which computer you view it from making it ideal for buisness forms, specification sheets, etc.; the disadvantage is that the text is converted into an image from which you often cannot easily copy and paste. PDF Scraping is the process of data scraping information contained in pdf files. To PDF scrape a PDF document, you must employ a more diverse set of tools.

There are two main types of PDF files: those built from a text file and those built from an image(likely scanned in). Adobe's own software is capable of PDF scraping from text-based PDF files but special tools are needed for PDF scraping text from image-based PDF files. The primary tool for PDF scraping is the OCR program. OCR, or Optical Character Recognition, programs scan a document for small pictures that they can separate into letters. These pictures are then compared to actual letters and if matches are found, the letters are copied into a file. OCR programs can perform PDF scraping of image-based PDF files quite accurately but they are not perfect.

Once the OCR program or Adobe program has finished PDF scraping a document, you can search through the data to find the parts you are most interested in. This information can then be stored into your favorite database or spreadsheet program. Some PDF scraping programs can sort the data into databases and/or spreadsheets automatically making your job that much easier.

Quite often you will not find a PDF scraping program that will obtain exactly the data you want without customization. Surprisingly a search on google only turned up one business, (the amusingly named ScrapeGoat.com) that will create a customized PDF scraping utility for your project. A handful of off the shelf utilities claim to be customizable, but seem to require a bit of programming knowledge and time commitment to use effectively. Obtaining the data yourself with one of these tools may be possible but will likely prove quite tedious and time consuming. It may be advisable to contract a company that specializes in PDF scraping to do it for you quickly and professionally.

Let's explore some real world examples of the uses of PDF scraping technology. A group at Cornell University wanted to improve a database of technical documents in PDF format by taking the old PDF file where the links and references were just images of text and changing the links and references into working clickable links thus making the database easy to navigate and cross-reference. They employed a PDF scraping utility to deconstruct the PDF files and figure out where the links were. They then could create a simple script to re-create the PDF files with working links replacing the old text image.

A computer hardware vendor wanted to display specifications data for his hardware on his website. He hired a company to perform PDF scraping of the hardware documentation on the manufacturers' website and save the PDF scraped data into a database he could use to update his webpage automatically.

PDF Scraping is just collecting information that is available on the public internet. PDF Scraping does not violate copyright laws.

PDF Scraping is a great new technology that can significantly reduce your workload if it involves retrieving information from PDF files. Applications exist that can help you with smaller, easier PDF Scraping projects but companies exist that will create custom applications for larger or more intricate PDF Scraping jobs.

Questions, comments, concerns? Make your voice heard at the PDF Scraping forums!
 
 
About the Author
Joe Broderick is a Physics/ComputerScience Major at Utah Valley State College. He has a loving wife Amber and no children.

Article Source: http://www.simplysearch4it.com/article/26868.html
 
If you wish to add the above article to your website or newsletters then please include the "Article Source: http://www.simplysearch4it.com/article/26868.html" as shown above and make it hyperlinked.



  
  Recent Articles
Record Management
by Ismael D. Tabije

Treasure Hunts
by John Tarr

What to Look for in Choosing IP Surveillance Software
by amit

Giving Your Business a Vision Others Can Envision
by Yvonne Weld

Productivity and Production Management
by Ismael D. Tabije

FDA Registration of Food Facilities
by Russell K. Statman

Why Businesses Today Fail - Part 1 Customer Service
by Jeffrey Solochek

Utilizing a Virtual Assistant is Just Good Business Sense
by Yvonne Weld

The Quest For An Auto Dealer
by Ashley Daniels

The Importance of Coaching
by Ashley Daniels

Finding The Right Business Investment
by Jason Sands

Commercial Flooring NY gives your office a professional look
by Stephen robins

Commercial Carpet Tiles are preferred by numerous professionals
by Stephen robins

Use Your Web Traffic Statistics
by Ray Herold

The Challenging and Rewarding Career of an Microsoft Certified Trainer (MCT)
by PrepMasters

Creating a mini Lead Generation System in Less than 24 Hours
by Dan Cavalli

Marketing Your Business Opportunity Online - How Do I Adapt To the Internet?
by Chad William Hershey

Removal Company UK
by jumphigher

Can't connect to database