dquangsinh / fb2pdf Goto Github PK

2007-03-06 04:04:11,776 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/4482001080e0236055b4a10ee9cce7fb.fb2' to
file
'grin_braian_yelegantnaya_vselennaya_superstruny_skrytye_razmernosti_i_poiski_ok
onchatelnoi_teorii.fb2'.
2007-03-06 04:04:37,767 DEBUG    Converting to TeX
2007-03-06 04:04:39,455 DEBUG    Converting to PDF
2007-03-06 04:04:41,924 ERROR    Conversion Failed
Traceback (most recent call last):
  File "/sw/bin/fbdaemon", line 200, in processDocument
    tex2pdf.tex2pdf(texfilename, pdffilename)
  File "/sw/lib/python2.4/site-packages/fb2pdf/tex2pdf.py", line 24, in tex2pdf
    raise PersistentError("Execution of pdflatex failed with error code %d"
% rc)
PersistentError: Execution of pdflatex failed with error code 256

During conversio process we should distinguish recoverable and
non-recoverable errors.

non-recoverable errors should cause file to be deleted from queue. E.g.
syntax error in FB2

recoverable errors should leave file in queue for another attempt. E.g. out
of disk space, S3 upload error, etc.

I suggest to create exceptions.py in fb2pdf package and put exception
hierarchy there.

2007-03-13 03:27:31,784 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/09c8fa3b011f
3d2b494ca7a653c13b90.fb2' to file 'kitayigorodskiyi_neveroyatno_ne_fakt.fb2'.

Needs investigation

* Epigraphs does not always look good, especially if they do not fit page.
Try alternative  epigraph packeages mentioned 
http://www.tex.ac.uk/cgi-bin/texfaq2html?label=epigraph here

Currently PDF info generation is commented in code (look for 'pdfinfo').
This was due to incorrect display of non-ascii chars. Perhaps same trick as
we do for TOC UTF8 encoding would work here?

2007-03-11 10:38:34,706 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/3bf
477a7bd6717f4ebaa5b885ab2f3c3.fb2' to file 'ulickaya_medeya_i_ee_deti.fb2'.

! LaTeX Error: There's no line here to end.

See the LaTeX manual or LaTeX Companion for explanation.
Type  H <return>  for immediate help.
 ...                                              

l.2937 \\

The problem seems to be with empty verse:

Иль в винные реестры кабака,\\
\\
Но опытом тончайшим, как струна,\\

2007-03-13 04:56:53,975 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/0e4
5c51887dc75b2b7c76fb3b23b2b11.fb2' to file 'akunin_boris_leviafan.fb2'.

Needs investigation

on noir.crocodile.org:

[INFO] Processing 'babel_odesskie_rasskaziy.fb2'.
[DEBUG] Creating temporary directory '/tmp/1172877164'.
[DEBUG] Downloading
'http://s3.amazonaws.com/fb2pdf/d70b226a4141a7edd218a76756c841a0.fb2' to
file 'babel_odesskie_rasskaziy.fb2.fb2'.
[DEBUG] Converting to TeX
[DEBUG] Converting to PDF
GNU Ghostscript 7.07: Unrecoverable error, exit code 1
[DEBUG] Uploading PDF to S3

I can see on some books, e.g. pushkin_evegeny_onegin that links inside
document are broken. footnote links always bring me to title page.

User reported that '-' are lost.

Currently we have hardcoded namepsace alias for 'href' attribute of 'a'
element. We expect 'l:href'. However namespace name could differ. For
example, pasternak_doktor_jivago.tex conversion produce errors:

<a type="note" xlink:href="#note1">1</a>
[WARNING] 'a' without 'href'
<a type="note" xlink:href="#note2">2</a>
[WARNING] 'a' without 'href'

Reproducible on the attached document. One of the problem lines looks like this:

\subsection{\texorpdfstring{АЛФАВИТ\hyperlink{note78}{\underline{78}}}{А
ЛФАВИТ 78}}

The error message is not descriptive and seems to depends on the context:

! Argument of \@sect has an extra }.
<inserted text> 
                \par 
l.2070 ...78}{\underline{78}}}{АЛФАВИТ 78}}

Focusing on text field in URL entry mode should remove explanaition text
"Type your URL here".

2007-03-06 05:39:13,297 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/87392d992ee543c86709257636fb50c4.fb2' to
file 'sagan_karl_kontakt.fb2'.
2007-03-06 05:39:25,009 DEBUG    Converting to TeX
2007-03-06 05:39:26,274 DEBUG    Converting to PDF
2007-03-06 05:39:26,632 ERROR    Conversion Failed
Traceback (most recent call last):
  File "/sw/bin/fbdaemon", line 200, in processDocument
    tex2pdf.tex2pdf(texfilename, pdffilename)
  File "/sw/lib/python2.4/site-packages/fb2pdf/tex2pdf.py", line 24, in tex2pdf
    raise PersistentError("Execution of pdflatex failed with error code %d"
% rc)
PersistentError: Execution of pdflatex failed with error code 256

2007-03-06 05:19:29,647 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/5a88bf710200588b1cd7e35d636178d1.fb2' to
file 'harper_pravda_ob_yutlandskom_boe.fb2'.
2007-03-06 05:20:03,278 DEBUG    Converting to TeX
2007-03-06 05:20:04,462 DEBUG    Converting to PDF
2007-03-06 05:20:05,126 ERROR    Conversion Failed
Traceback (most recent call last):
  File "/sw/bin/fbdaemon", line 200, in processDocument
    tex2pdf.tex2pdf(texfilename, pdffilename)
  File "/sw/lib/python2.4/site-packages/fb2pdf/tex2pdf.py", line 24, in tex2pdf
    raise PersistentError("Execution of pdflatex failed with error code %d"
% rc)
PersistentError: Execution of pdflatex failed with error code 256

2007-03-14 09:40:52,316 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/9123a1b04f955967436c2329fccef564.fb2' to file '
kompyuterra_kompyuterra_677_jurnal_kompyuterra_n_9_ot_06_marta_2007_goda.fb2'.

[DEBUG] Converting to TeX
[DEBUG] Converting to PDF
[DEBUG] Uploading resulting file to S3
Traceback (most recent call last):
  File "/sw/lib/python2.4/logging/__init__.py", line 729, in emit
    msg = self.format(record)
  File "/sw/lib/python2.4/logging/__init__.py", line 615, in format
    return fmt.format(record)
  File "/sw/lib/python2.4/logging/__init__.py", line 403, in format
    record.message = record.getMessage()
  File "/sw/lib/python2.4/logging/__init__.py", line 274, in getMessage
    msg = msg % self.args
TypeError: not all arguments converted during string formatting
Traceback (most recent call last):
  File "/sw/lib/python2.4/logging/__init__.py", line 729, in emit
    msg = self.format(record)
  File "/sw/lib/python2.4/logging/__init__.py", line 615, in format
    return fmt.format(record)
  File "/sw/lib/python2.4/logging/__init__.py", line 403, in format
    record.message = record.getMessage()
  File "/sw/lib/python2.4/logging/__init__.py", line 274, in getMessage
    msg = msg % self.args
TypeError: not all arguments converted during string formatting
[DEBUG] Uploading log to S3
[DEBUG] Processing callbacks

I have no idea where it happens!

[DEBUG] Downloading
'http://s3.amazonaws.com/fb2pdf/57641cb8f73cbba1fac353411114a655.fb2' to
file 'fictionbook_2_1.fb2'.
[DEBUG] Converting to TeX
No handlers could be found for logger "fb2tex"

When file have multiple nested sections, they are not properly nested in TOC.
To be investigated further.

File: astafev_proklyatiy_i_ubitiy_kniga_pervaya_chertova_yama.fb

Please make sure UI does not send empty file names.

daemon seems to process them OK, but they do not look nice:

mbenzi /Users/lord/src/fb2pdf> ./r.sh 
[INFO] Starting
[DEBUG] Received new task
[INFO] Processing ''.
[DEBUG] Creating temporary directory '/tmp/1173163107'.
[DEBUG] Downloading
'http://s3.amazonaws.com/fb2pdf/7d291a304e7b71e61a5016845906bea5.fb2' to
file '.fb2'.
[DEBUG] Converting to TeX
[DEBUG] Converting to PDF
[DEBUG] Uploading PDF to S3
[DEBUG] Uploading log to S3
[DEBUG] Removing temp files

When calling pdflatex we should perform proper shell escaping. I've added
rudimentary one, but it is not enough.

Related:
http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/498202

Send an email to user even if file already been converted and exists in the
DB. 

Currently email notification works only for new files.

/sw/lib/python2.4/site-packages/fb2pdf/fb2tex.py:582: RuntimeWarning:
tempnam is a potential security risk to your program
  fname = os.tempnam(".", "enc") + "." + image_exts[ct]


get rid of it.

2007-03-09 10:06:15,932 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/60822bba00ff5a69f6e7e4523d7a6276.fb2' to fil
e 'berberova_nina_lyudi_i_lozhi_russkie_masony_xx_stoletiya.fb2'.


  File "/usr/local/lib/python2.4/site-packages/fb2pdf/fb2tex.py", line 371,
in processSection
    processSection(x,f)
  File "/usr/local/lib/python2.4/site-packages/fb2pdf/fb2tex.py", line 378,
in processSection
    _uwrite(f,par(x))
  File "/usr/local/lib/python2.4/site-packages/fb2pdf/fb2tex.py", line 58,
in par
    res += '\\hyperlink{' + href[1:] + '}{\\underline{' +
_textQuote(_text(s)) + '}}'
  File "/usr/local/lib/python2.4/site-packages/fb2pdf/fb2tex.py", line 143,
in _text
    raise Exception("Expected TEXT, got " + x.tagName)
Exception: Expected TEXT, got strong

Reproducible on the attached document. Author name is missing, but I don't 
think that this is the 
problem.

===========
! LaTeX Error: There's no line here to end.

See the LaTeX manual or LaTeX Companion for explanation.
Type  H <return>  for immediate help.
 ...                                              

l.270   {}
===========

PDFLATEX fails on:

2007-03-11 15:46:24,331 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/7b8
20c66b6cbf27f718570841c907969.fb2' to file 'vonnegut_maliyyi_ne_promah.fb2'.


need to be investigated further.

2007-03-14 04:07:37,061 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/a38dda5daa93c4ecdb0c9a79fc4825dd.fb2' to file '
stark_richard_grabiteli.fb2'.

Underfull \vbox (badness 5726) has occurred while \output is active [1070]
! Undefined control sequence.
<argument> ...CYRI \CYRT \CYRO \CYRG \CYRI \U3Б─╕ 

l.8179 \end{document}

? 

At this line I see:

}
\end{document}

Seems like erroneous curly bracket


file papanin_ivan_led_i_plamen.fb.

[DEBUG] Downloading
'http://s3.amazonaws.com/fb2pdf/cb03dfcb50da8d89257e738addffa587.fb2' to
file '4pda_kollektiv_zhurnal_4pda_no1_2007_g.fb2'.

We should offer user choice of several fonts to use when generating PDF.

It could be interesting to know how many books was converted between period
of time. For that I think we should add timestamp field to Books table.

! Undefined control sequence.
l.1213 \poemtitle
                 {БЕССМЕРТНЫЕ}

[118] [119]
! Missing number, treated as zero.
<to be read again> 
                   l
l.1433 ...voice has a timid and tremulous sound. ]
                                                  \\
? 


file:

 wget http://s3.amazonaws.com/fb2pdf/998ded742c5917cf920b3c813ba60700.fb2
-O carroll_lewis_alices_adventures_in_wonderland.fb2

2007-03-06 01:16:59,680 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/6eaf159360d4abf5b8380caba6f97783.fb2' to
file
'kompyuterra_kompyuterra_676_jurnal_kompyuterra_n_8_ot_27_fevralya_2007_goda.fb2
'.
2007-03-06 01:17:30,517 DEBUG    Converting to TeX
2007-03-06 01:17:31,406 ERROR    Conversion Failed
Traceback (most recent call last):
  File "/sw/bin/fbdaemon", line 197, in processDocument
    fb2tex.fb2tex(fbfilename, texfilename)
  File "/sw/lib/python2.4/site-packages/fb2pdf/fb2tex.py", line 206, in fb2tex
    processDescription(fb.find("description"), f)
  File "/sw/lib/python2.4/site-packages/fb2pdf/fb2tex.py", line 501, in
processDescription
    author_name = authorName(a)
  File "/sw/lib/python2.4/site-packages/fb2pdf/fb2tex.py", line 461, in
authorName
    author_name = _text(fn)
  File "/sw/lib/python2.4/site-packages/fb2pdf/fb2tex.py", line 127, in _text
    return string.join([convXMLentities(e) for e in  t.contents])
  File "/sw/lib/python2.4/site-packages/fb2pdf/fb2tex.py", line 115, in
convXMLentities
    return s.replace('&lt;','<') \
TypeError: 'NoneType' object is not callable

Please mention on web page that ZIP files are also accepted.

2007-03-06 05:12:11,351 INFO     Processing
'gamov_georgii_priklyucheniya_mister
a_tompkinsa'.
2007-03-06 05:12:11,352 DEBUG    Creating temporary directory
'/tmp/1173186731'.
2007-03-06 05:12:11,424 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/cb8
d5c26e33be094bef4f78b2486b5fa.fb2' to file
'gamov_georgii_priklyucheniya_mistera
_tompkinsa.fb2'.
2007-03-06 05:15:52,175 DEBUG    Converting to TeX
2007-03-06 05:16:07,104 DEBUG    Converting to PDF
2007-03-06 05:16:18,542 ERROR    Conversion Failed
Traceback (most recent call last):
  File "/usr/local/bin/fbdaemon", line 200, in processDocument
    tex2pdf.tex2pdf(texfilename, pdffilename)
  File "/usr/local/lib/python2.4/site-packages/fb2pdf/tex2pdf.py", line 24,
in t
ex2pdf
    raise PersistentError("Execution of pdflatex failed with error code %d"
% rc
)
PersistentError: Execution of pdflatex failed with error code 256

In most books, it section title contains spaces, they are now shown in TOC.
TOC looks ugly, words running into each other.

In file  panov_vadim_moskovskii_klub all chapters repeated twice.

Underfull \vbox (badness 10000) has occurred while \output is active [127]
! Misplaced alignment tab character &.
l.2684 \textbackslash &
                        laquo;п║п©п╣я┬п╦я┌п╣, пЁп╣я─п╬п╦, п╫п╣я│я┐я┴п╦п╣ п╩я...


Produced on gumilev_sbornik_stihov.fb2.

I can see S3 download which is stuck for 20+ minutes. Last message in log:

2007-03-06 10:11:25,083 DEBUG    Creating temporary directory
'/tmp/1173204685'.
2007-03-06 10:11:25,085 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/6ea
f159360d4abf5b8380caba6f97783.fb2' to file
'kompyuterra_kompyuterra_676_jurnal_k
ompyuterra_n_8_ot_27_fevralya_2007_goda.fb2'.

We should put some reasonable timeout on download.

2007-03-16 09:12:11,082 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/24df732b472e9626cda3
a0e7fd97359f.fb2' to file 'mayier_cheshejopica_ocherki_tyuremniyh_nravov.fb2'.

needs further investigation

2007-03-12 13:45:24,195 INFO     Processing
'ilf_ilya_zolotoi_telenok_illyustracii_kukryniksy'.
2007-03-12 13:45:24,196 DEBUG    Creating temporary directory
'/tmp/1173732324'.
2007-03-12 13:45:24,196 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/d9f5d0c4358bfe63e7f95eb190cdaf3b.fb2
' to file 'ilf_ilya_zolotoi_telenok_illyustracii_kukryniksy.fb

needs further investigation

2007-03-09 05:51:39,728 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/bd06ae65d1659e77509f91468f95cee0.fb2' to fil
e 'koh_alfred_yashik_vodki_tom_3.fb2'.

! Argument of \@sect has an extra }.
<inserted text> 
                \par 
l.4340 ...perlink{FbAutId_5}{\underline{{[}5{]}}}}

? 

Problematic section:

\subsection{ТОТАЛЬНАЯ\ ДЕМОБИЛИЗАЦИЯ\
\hyperlink{FbAutId_5}{\underline{{[}5{]}}}}

On Fedora Core 5 -d option prevents daemon from starting. It works fine
without -d. I suspect problem is with daemon.py.

2007-03-09 09:11:45,574 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/a840c3ee9c1d91630b5c5790b82d6f40.fb2' to fil
e 'ulickaya_lyudmila_daniyel_shtain_perevodchik.fb2'.

! LaTeX Error: Something's wrong--perhaps a missing \item.

See the LaTeX manual or LaTeX Companion for explanation.
Type  H <return>  for immediate help.
 ...                                              

l.2040 \end{quotation}

2007-03-12 13:45:24,196 DEBUG    Downloading
'http://s3.amazonaws.com/fb2pdf/d9f5d0c4358b
fe63e7f95eb190cdaf3b.fb2' to file
'ilf_ilya_zolotoi_telenok_illyustracii_kukryniksy.fb2'.

Needs investigation

    processSection(s, f)
  File "/sw/lib/python2.4/site-packages/fb2pdf/fb2tex.py", line 363, in
processSection
    processSection(x,f)
  File "/sw/lib/python2.4/site-packages/fb2pdf/fb2tex.py", line 363, in
processSection
    processSection(x,f)
  File "/sw/lib/python2.4/site-packages/fb2pdf/fb2tex.py", line 381, in
processSection
    processCite(x,f)
  File "/sw/lib/python2.4/site-packages/fb2pdf/fb2tex.py", line 346, in
processCite
    processAuthors(q,f)
  File "/sw/lib/python2.4/site-packages/fb2pdf/fb2tex.py", line 318, in
processAuthors
    author_name = _textQuote(_text(a))
  File "/sw/lib/python2.4/site-packages/fb2pdf/fb2tex.py", line 142, in _text
    raise Exception("Expected TEXT, got " + x.tagName)
Exception: Expected TEXT, got emphasis

To get file file:

wget http://s3.amazonaws.com/fb2pdf/f7fc5fc73e0e8fa8600c7e664c6ef262.fb2 -O
akunin_boris_almaznaya_kolesnica_tom_1.fb2

Somewhere, at the last page perhaps, or in footer of the title page we
should insert line "Generated by FB2PDF.
http://www.codeminders.com/fb2pdf/".

It should be unobtrusive and tasteful.

Many users are on slow connections (esp. in Russia). Downloading huge PDF
takes time. We should have an option in UI: "ZIP resulting PDF". If it is
checked appropriate flag should be passed in event to daemon and it would
upload resulting file as ZIP with PDF inside.

Reproducible on bykov_orfografiya.fb2. Four-digit page numbers in TOC run 
outside the right page 
margin.