Facing issue when tried to run following code:

import camelot tables = camelot.read_pdf('test.pdf')

Error:

tables = camelot.read_pdf('Unaudited-Financial-Results.pdf') Traceback (most recent call last): File "C:\Users\hp1\Anaconda2\envs\lib\site-packages\camelot\parsers\la ttice.py", line 193, in get_executable raise ValueError ValueError

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "", line 1, in File "C:\Users\hp1\Anaconda2\envs\lib\site-packages\camelot\io.py", li ne 101, in read_pdf tables = p.parse(flavor=flavor, **kwargs) File "C:\Users\hp1\Anaconda2\envs\lib\site-packages\camelot\handlers.p y", line 157, in parse t = parser.extract_tables(p) File "C:\Users\hp1\Anaconda2\envs\lib\site-packages\camelot\parsers\la ttice.py", line 356, in extract_tables self._generate_image() File "C:\Users\hp1\Anaconda2\envs\lib\site-packages\camelot\parsers\la ttice.py", line 220, in _generate_image gs = get_executable() File "C:\Users\hp1\Anaconda2\envs\lib\site-packages\camelot\parsers\la ttice.py", line 206, in get_executable 'Please make sure that Ghostscript is installed' camelot.parsers.lattice.GhostscriptNotFound: Please make sure that Ghostscript i s installed and available on the PATH environment variable

When checked in cmd for GhostScript it shows successfully installed and Path is set correctly:

C:>gswin64c.exe -version GPL Ghostscript 9.25 (2018-09-13) Copyright (C) 2018 Artifex Software, Inc. All rights reserved.

Also, instead of lattice, if stream method is used, a csv file can be generated successfully:

tables = camelot.read_pdf('test.pdf', flavor='stream', table_area tables

`--------------------------------------------------------------------------- ImportError Traceback (most recent call last) in () 1 import pandas as pd ----> 2 import camelot

/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/camelot/init.py in () 4 5 from .version import version ----> 6 from .io import read_pdf 7 8

/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/camelot/io.py in () 1 # -- coding: utf-8 -- 2 ----> 3 from .handlers import PDFHandler 4 from .utils import validate_input, remove_extra 5

/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/camelot/handlers.py in () 5 from PyPDF2 import PdfFileReader, PdfFileWriter 6 ----> 7 from .core import TableList 8 from .parsers import Stream, Lattice 9 from .utils import (TemporaryDirectory, get_page_layout, get_text_objects,

ImportError: cannot import name 'TableList'`

• move plot() to plotting.py as plot_pdf()
• add filename param to plot_pdf()
• modify plotting functions to return matplotlib figures
• add test_plotting.py and baseline images
• import plot_pdf() in __init__
• update cli.py to use plot_pdf()
• update advanced usage docs to reflect changes

When I am reading a pdf filw with multiple pages, I am only getting first page by default.

When I am using this code read_pdf(sample.pdf, pages='1-2') or read_pdf(sample.pdf, pages='all') or read_pdf(sample.pdf, pages='1,2') I am getting following error.

AttributeError: 'PDFHandler' object has no attribute 'password'

Can you please fix this issue

Versions: Linux-4.9.0-6-amd64-x86_64 Python 3.6.5 |Anaconda, Inc.| (default, Apr 29 2018, 16:14:56) [GCC 7.2.0] NumPy 1.15.2 OpenCV 3.4.2

Hi,

Can you please support reading languages in Arabic fonts?

In particular, I'm trying to extract tables from this document (backup link since Scribd seems to be down right now).

Starting at page 6, the document presents lines of Arabic on the left column and lines of English in the right column. I used these commands to extract that text as a table:

tables = camelot.read_pdf('quran.pdf', pages='6',columns=['240'])
tables.export('quran.csv', f='csv', compress=False)

However, the extracted table has two issues:

1. The (I think unicode) characters for the Arabic text seem to have either been corrupted in the process or they've lost any mapping to the Arabic fonts. Even when I tried opening up the file in Google Sheets & other editors and set the font to Arabic the words would still not be properly displayed

2. Text that should have been on the same row of two different rows is instead placed in two different columns of the same row. (This is a minor annoyance that I can easily work around, and perhaps you tool already has a fix for this that I haven't discovered)

Below is the full output generated by the above command. Interestingly, in the beginning part of the file (line 3 and a bit of line 4) you can at least recognize the Arabic letters. However, again there are two issues:

1. The order of the letters has been flipped around. This is probably due to the fact that Arabic reads from right to left. I suspect PDFminer gave Camelot the letters in the "correct" left to right order, but Camelot, not being aware that the letters should be read in the opposite order, flipped the order around
2. The two lines of visible Arabic are both from the same word, the characters of which somehow got split into two different rows

"ِ",""
"",""
"ِةِِ حـِتاَف",""
"ْلَا","al-Fātiḥah"
"َ",""
"",""
"","1.  1In the Name of Allah,"
"",""
"","the All-beneficent, the All-merciful."
"",""
"","2. All praise belongs to Allah,2"
"",""
"",""
"","Lord of all the worlds,"
"",""
"","3. the All-beneficent, the All-merciful,"
"",""
"","4. Master3 of the Day of Retribution."
"",""
"","5. You [alone] do we worship,"
"",""
"","and to You [alone] do we turn for help."
"",""
"","6. Guide us on the straight path,"
"",""
"","7. the path of those whom You have blessed4"
"",""
"","—such as5 have not incurred Your wrath,6"
"1 That is, ‘the opening’ sūrah. Another common name of the sūrah is ‘Sūrat al-Ḥamd, ’that is, the sūrah of",""
"the [Lord’s] praise.",""
"2 In Muslim parlance the phrase al-ḥamdu lillāh also signifies ‘thanks to Allah.’",""
"3 This is in accordance with the reading mālik yawm al-dīn, adopted by ‘Āṣim, al-Kisā’ī, Ya‘qūb al-Ḥaḍramī,",""
"and Khalaf. Other authorities of qirā’ah (the art of recitation of the Qur’ān) have read ‘malik yawm al-",""
"","dīn,’meaning ‘Sovereign of the Day of Retribution’(see Mu‘jam al-Qirā’āt al-Qur’āniyyah). Traditions ascribe"
"both readings to Imam Ja‘far al-Ṣādiq (‘a). See al-Qummī, al-‘Ayyāshī, Tafsīr al-Imām al-‘Askarī.",""
"4 For further Qur’ānic references to ‘those whom Allah has blessed,’see 4:69 and 19:58; see also 5:23, 110;",""
"12:6; 27:19; 28:17; 43:59; 48:2.",""
"5 This is in accordance with the qirā’ah of ‘Āṣim, ghayril-maghḍūbi, which appears in the Arabic text above.",""
"","However, in accordance with an alternative, and perhaps preferable, reading ghayral-maghḍūbi (attributed"

This is the file I want to parse. W020180518365531252048.pdf PdfReadWarning: Illegal character in Name Object [generic.py:489] Traceback (most recent call last): File "D:\Python\Python36\lib\site-packages\IPython\core\interactiveshell.py", line 2961, in run_code exec(code_obj, self.user_global_ns, self.user_ns) File "", line 1, in tables = camelot.read_pdf("W020180518365531252048.pdf") File "D:\Python\Python36\lib\site-packages\camelot\io.py", line 91, in read_pdf tables = p.parse(flavor=flavor, **kwargs) File "D:\Python\Python36\lib\site-packages\camelot\handlers.py", line 141, in parse self._save_page(self.filename, p, tempdir) File "D:\Python\Python36\lib\site-packages\camelot\handlers.py", line 95, in save_page layout, dim = get_page_layout(fpath) File "D:\Python\Python36\lib\site-packages\camelot\utils.py", line 586, in get_page_layout document = PDFDocument(parser) File "D:\Python\Python36\lib\site-packages\pdfminer.six-20170720-py3.6.egg\pdfminer\pdfdocument.py", line 566, in init xref.load(parser) File "D:\Python\Python36\lib\site-packages\pdfminer.six-20170720-py3.6.egg\pdfminer\pdfdocument.py", line 195, in load (, obj) = parser.nextobject() File "D:\Python\Python36\lib\site-packages\pdfminer.six-20170720-py3.6.egg\pdfminer\psparser.py", line 606, in nextobject raise PSSyntaxError('Invalid dictionary construct: %r' % objs) pdfminer.psparser.PSSyntaxError: Invalid dictionary construct: [/'Type', /'Font', /'Subtype', /'Type0', /'BaseFont', /b"b'", /"ABCDEE+\xb7\xc2\xcb\xce'", /'Encoding', /'Identity-H', /'DescendantFonts', PDFObjRef:6, /'ToUnicode', PDFObjRef:12]

This is a cleaner way to interact with the ghostscript, need to see if this PyPI package is available in anaconda or not. Also need to suppress the unnecessary logs generated by ghostscript.

EDIT: If it isn't available, maybe we could vendorize it.

Closes #152.

My code

tables = camelot.read_pdf("./test/spyglass.pdf")

The error:

Traceback (most recent call last):
  File "camelot.py", line 1, in <module>
    import camelot
  File "/Users/milad/Desktop/projects/shamrock/camelot.py", line 2, in <module>
    tables = camelot.read_pdf("./test.pdf");
AttributeError: 'module' object has no attribute 'read_pdf'

Camelot supports plotting of 5 types of geometries for debugging and tweaking parser configurations.

Plotting needs to be refactored in such a way that all plot functions return a matplotlib figure, so that they can be tested either by using pytest or matplotlib's image_comparison decorator. You can also check how pandas tests plots.

The user should be given an option to save their plots, in addition to the current option of just displaying the figure, which might fail when there are no screens available.

The new plots should also be tested to work in Jupyter notebooks.

Having trouble running this code on my mac. Using Conda virtual env and installed using conda. Pdf is not password protected.

import camelot import pandas as pd import re import numpy as np table1 = camelot.read_pdf('IEEJ - 2019 - Outlook.pdf')

NotImplementedError Traceback (most recent call last) in ----> 1 table1 = camelot.read_pdf('IEEJ - 2019 - Outlook.pdf')#, pages = ex_page, password = None)#, area = (left, 112, right,112+ 90)) 2 table1

/anaconda3/envs/tensorflow/lib/python3.6/site-packages/camelot/io.py in read_pdf(filepath, pages, password, flavor, suppress_stdout, layout_kwargs, **kwargs) 104 kwargs = remove_extra(kwargs, flavor=flavor) 105 tables = p.parse(flavor=flavor, suppress_stdout=suppress_stdout, --> 106 layout_kwargs=layout_kwargs, **kwargs) 107 return tables

/anaconda3/envs/tensorflow/lib/python3.6/site-packages/camelot/handlers.py in parse(self, flavor, suppress_stdout, layout_kwargs, **kwargs) 153 with TemporaryDirectory() as tempdir: 154 for p in self.pages: --> 155 self._save_page(self.filepath, p, tempdir) 156 pages = [os.path.join(tempdir, 'page-{0}.pdf'.format(p)) 157 for p in self.pages]

/anaconda3/envs/tensorflow/lib/python3.6/site-packages/camelot/handlers.py in _save_page(self, filepath, page, temp) 98 infile = PdfFileReader(fileobj, strict=False) 99 if infile.isEncrypted: --> 100 infile.decrypt(self.password) 101 fpath = os.path.join(temp, 'page-{0}.pdf'.format(page)) 102 froot, fext = os.path.splitext(fpath)

/anaconda3/envs/tensorflow/lib/python3.6/site-packages/PyPDF2/pdf.py in decrypt(self, password) 1985 self._override_encryption = True 1986 try: -> 1987 return self._decrypt(password) 1988 finally: 1989 self._override_encryption = False

/anaconda3/envs/tensorflow/lib/python3.6/site-packages/PyPDF2/pdf.py in _decrypt(self, password) 1994 raise NotImplementedError("only Standard PDF encryption handler is available") 1995 if not (encrypt['/V'] in (1, 2)): -> 1996 raise NotImplementedError("only algorithm code 1 and 2 are supported") 1997 user_password, key = self._authenticateUserPassword(password) 1998 if user_password:

NotImplementedError: only algorithm code 1 and 2 are supported

The experimental version exists before this commit 9753889ea266c3b8e412d77eb411617ec40d8393. It uses Tesseract (using pyocr). ocropy looked promising the last time I checked, opening this issue for discussion and experiments around OCR.

An earlier issue around the same topic: #14

Try to install with pip defaulting to Python2 (see Python3 attempt further down)

% git clone https://www.github.com/camelot-dev/camelot % cd camelot % pip install ".[cv]"
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support pip 21.0 will remove support for this functionality. Processing /Users/psommerfeld/Dropbox/work/camelot ERROR: Command errored out with exit status 1: command: /Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/Python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/7s/8v3x7mf531q3bblgckwq8hl00000gn/T/pip-req-build-RkYLrh/setup.py'"'"'; file='"'"'/private/var/folders/7s/8v3x7mf531q3bblgckwq8hl00000gn/T/pip-req-build-RkYLrh/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' egg_info --egg-base /private/var/folders/7s/8v3x7mf531q3bblgckwq8hl00000gn/T/pip-pip-egg-info-5J2Gos cwd: /private/var/folders/7s/8v3x7mf531q3bblgckwq8hl00000gn/T/pip-req-build-RkYLrh/ Complete output (8 lines): Traceback (most recent call last): File "", line 1, in File "/private/var/folders/7s/8v3x7mf531q3bblgckwq8hl00000gn/T/pip-req-build-RkYLrh/setup.py", line 10, in exec(f.read(), about) File "", line 11 version_parts.append(f"-{prerelease}") ^ SyntaxError: invalid syntax ---------------------------------------- ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

Try with Python3:

% python3 -m pip install "[.cv]"
ERROR: Exception: Traceback (most recent call last): File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pip/_vendor/packaging/requirements.py", line 102, in init req = REQUIREMENT.parseString(requirement_string) File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pip/_vendor/pyparsing/core.py", line 1141, in parse_string raise exc.with_traceback(None) pip._vendor.pyparsing.exceptions.ParseException: Expected string_end, found '[' (at char 11), (line:1, col:12)

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pip/_internal/cli/base_command.py", line 160, in exc_logging_wrapper status = run_func(*args) File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pip/_internal/cli/req_command.py", line 247, in wrapper return func(self, options, args) File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pip/_internal/commands/install.py", line 344, in run reqs = self.get_requirements(args, options, finder, session) File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pip/_internal/cli/req_command.py", line 411, in get_requirements req_to_add = install_req_from_line( File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pip/_internal/req/constructors.py", line 393, in install_req_from_line parts = parse_req_from_line(name, line_source) File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pip/_internal/req/constructors.py", line 332, in parse_req_from_line extras = convert_extras(extras_as_string) File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pip/_internal/req/constructors.py", line 57, in convert_extras return get_requirement("placeholder" + extras.lower()).extras File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pip/_internal/utils/packaging.py", line 45, in get_requirement return Requirement(req_string) File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pip/_vendor/packaging/requirements.py", line 104, in init raise InvalidRequirement( pip._vendor.packaging.requirements.InvalidRequirement: Parse error at "'[.cv]'": Expected string_end

I made the following changes in this PR:

• Removed unnecessary multiplication of vertical and horizontal arrays, as it seems to be excessive, so I tried to improve that bit (I might be wrong though, but it seems like that)
• Changed the try-except block to just a single line that calls cv2.findContours() and gets the second element of the returned tuple, which is the list of contours
• Simplified the calculation for the coordinates of the joint by using int division to calculate the center of the bounding rectangle for each contour (about htis one, first we are tracing the contours of the object in the image, then drawing a rectangle around each contour, then finding the point in the middle and in the end using this point as an est for the coordinates of the joint we were looking for)

Ping me if there are any questions, thanks.

a pdf file has tow pages ,the first page has 3 tables,the second has 2 tables. but when use camelot.read_pdf ,with parameter： pages='all', the result return only 3 tables,not 5 tables.

import camelot tables = camelot.read_pdf('a22.pdf',pages='all') tables

Hello,

There is a daily pdf report whose last page has no tables, but whose total number of pages vary each day.

I cannot extract 'all' when there is a page with no table: _

File ~\anaconda3\lib\site-packages\camelot\io.py:113 in read_pdf tables = p.parse(

File ~\anaconda3\lib\site-packages\camelot\handlers.py:176 in parse t = parser.extract_tables(

File ~\anaconda3\lib\site-packages\camelot\parsers\stream.py:456 in extract_tables self._generate_table_bbox()

File ~\anaconda3\lib\site-packages\camelot\parsers\stream.py:310 in _generate_table_bbox table_bbox = self._nurminen_table_detection(hor_text)

File ~\anaconda3\lib\site-packages\camelot\parsers\stream.py:287 in _nurminen_table_detection table_bbox = textedges.get_table_areas(textlines, relevant_textedges)

File ~\anaconda3\lib\site-packages\camelot\core.py:221 in get_table_areas average_textline_height = sum_textline_height / float(len(textlines))

ZeroDivisionError: float division by zero

_

And cannot index the reading pages from first to second to last, as I cannot know beforehand the total number of pages.

Can you help me out?

Hello,

I am working with a pdf which I can not share due to confidentiality, however my question and issue is very simple. The pdf format is what we call "stream" BUT with vertical tabular lines between each column. So in the end I dont have row-lines but have column-lines.

When I use camelot like this: camelot.read_pdf('mypdf.pdf', flavor="stream", pages="all", split_text=True)

since my 2 columns are very close to each other (but seperated with the line I mentioned) camelot merges these two columns even I use split_text = True. Is there a harmonic method available for me to use "stream" but with appying vertial -OR- horizontal line avareness to the conversion.

I know that I can use manual-inputted column cut point coordinate with "split" parameter but all my pdf files arrives with different split coordination so I can not hardcode some points. All I have in common is these vertical column seperator lines.

Do you have a built-in solution for solving these kind of problems? If not, do you have a plan to add it in upcoming releases?

Best.