08-29-2020, 12:16 PM | #1 |
Connoisseur
Posts: 54
Karma: 10
Join Date: May 2010
Location: Oakville, ON, Canada
Device: Kobo Forma
|
Best practices for uploading large book collection via Calibre?
Hello all,
just got this morning my brand new Forma. After some challenges (the Kobo website is down so I had to hack the registration) the Kobo is up and running. I started to transfer my book collection using Calibre. And here I have a challenge: when I transfer a large number of books - I alway get an error in Calibre "Error communicating with device" and the transfer fails. I have already removed the Kobo utilities plug-in and I have plugged the Kobo directly into my laptop (so no USB hub) - but I still get this error. Yes, I can transfer 10 books at a time - but with many hundreds of books that is a pain. Is there a recommended way for transferring hundreds of books in one go? Thank you for any suggestions! (The communication itself works well between laptop and Kobo - I copied 2 GB of PDF to the unit with copy - paste with no problem) |
08-29-2020, 12:30 PM | #2 | |
Resident Curmudgeon
Posts: 74,375
Karma: 129333690
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
|
Quote:
Anyway, are you transferring ePub or KePub? Have you tried both to see which one you want to use for side loaded eBooks? Once you figure this out, if you do go for KePub, you'll want to use the KoboTouchExtended driver convert ePub to KePub and load them on your Forma. Try side loading a smaller amounts and see if that works like maybe 10 at a time. |
|
Advert | |
|
08-29-2020, 07:16 PM | #3 | |
Connoisseur
Posts: 54
Karma: 10
Join Date: May 2010
Location: Oakville, ON, Canada
Device: Kobo Forma
|
Quote:
I am unable to properly set up as Kobo is currently down... Maybe will redo when Kobo is again operational. |
|
08-29-2020, 11:49 PM | #4 | ||
Grand Sorcerer
Posts: 24,906
Karma: 47303748
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
Quote:
From the point of view of loading a new device, I have sideload several thousand from calibre in one go. I usually limit it to batches of 1000, but that's as much about patience and wanting to use the device as anything else. I haven't had a problem doing this in the last few years. Quote:
|
||
08-30-2020, 11:03 AM | #5 | |
Connoisseur
Posts: 54
Karma: 10
Join Date: May 2010
Location: Oakville, ON, Canada
Device: Kobo Forma
|
Quote:
For the Calibre plugins: with the plugins installed I was not able to transfer more than 10 or so books in one run - otherwise I got errors. With the plugins removed I was able to transfer all ebooks in one run, no problem (500+ books). That lead me to beleive that one of the plugins was the culprit. I did it now again (as I did a factory reset and proper setup after properly activating with Kobo this morning) and Calibre transferred again all books at once with no issue (but I have not reinstalled any plugin yet). Will start to reinstall the plugins one by one when I have some time to determine which one is the culprit. |
|
Advert | |
|
08-30-2020, 01:42 PM | #6 |
Grand Sorcerer
Posts: 12,225
Karma: 74000000
Join Date: Nov 2007
Location: Toronto
Device: Nexus 7, Clara, Touch, Tolino EPOS
|
I wonder if there might be a timeout issue when using the Kobo Touch Extended driver to transfer a large number of books to the device, and it having to massage the ePubs to create kEpubs during the transfer?
|
08-30-2020, 02:11 PM | #7 |
Wizard
Posts: 1,117
Karma: 2094306
Join Date: Oct 2011
Location: Montreal, Canada
Device: Lots and lots of electronic gadgets...
|
I just had the same issue with my Kobo Glo HD (with new firmware) and am now trying with 1000 books at a time. Am uploading epubs.
|
08-30-2020, 08:58 PM | #8 |
Grand Sorcerer
Posts: 24,906
Karma: 47303748
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
There shouldn't be. It does the work to transform the books on local disk. Then it copies the book to the device and possibly does a database update. None of that is time sensitive. Without know where and what the error was, it's pretty hard to guess.
|
08-31-2020, 02:43 PM | #9 |
Wizard
Posts: 1,117
Karma: 2094306
Join Date: Oct 2011
Location: Montreal, Canada
Device: Lots and lots of electronic gadgets...
|
No go when I tried to add 1000 books at a time to my Glo HD - I therefore removed the Kobo add-ons and then added them back again. It seems the problem is (according to the job list) getting the list of books on device - that always ends in an error.
IOError: disk I/O error Traceback (most recent call last): File "site-packages\calibre\gui2\device.py", line 90, in run File "site-packages\calibre\gui2\device.py", line 513, in _books File "site-packages\calibre\devices\kobo\driver.py", line 1964, in books File "c:\t\t\apsw-w7591s5i\src\cursor.c", line 236, in resetcursor IOError: IOError: disk I/O error I have since (without re-starting Calibre) just tried 399 books and got an error. So for the book transfer, it seems the problem is a corrupted file (which I have removed). I can't figure out what the issue getting the kobo's book list into Calibre is though. ADDITIONAL INFO: I removed the file that was corrupted according to the error message and got the same message with the next file in the list when I tried again... My Glo is now only good for 300 or so books - so disappointed - it's been used very sporadically and with kid gloves and now seems "broken" because of this update. [Error 1392] The file or directory is corrupted and unreadable: u'E:\\Holiday, Jenny' Traceback (most recent call last): File "site-packages\calibre\gui2\device.py", line 90, in run File "site-packages\calibre\gui2\device.py", line 594, in _upload_books File "calibre_plugins.kobotouch_extended.device.driver" , line 403, in upload_books File "site-packages\calibre\devices\kobo\driver.py", line 2132, in upload_books File "site-packages\calibre\devices\usbms\driver.py", line 324, in upload_books File "site-packages\calibre\devices\usbms\device.py", line 998, in create_upload_path File "os.py", line 157, in makedirs WindowsError: [Error 1392] The file or directory is corrupted and unreadable: u'E:\\Holiday, Jenny' Last edited by Cdesja5; 09-01-2020 at 03:45 PM. |
09-01-2020, 12:57 PM | #10 |
Connoisseur
Posts: 51
Karma: 10
Join Date: May 2009
Location: Germany
Device: Kobo(s), Pocketbook(s), MacBook Pro, iPhone
|
Are you sure that you don't exceed the capacity of the internal memory? I've got a similar problem some time ago ...
|
09-01-2020, 03:43 PM | #11 |
Wizard
Posts: 1,117
Karma: 2094306
Join Date: Oct 2011
Location: Montreal, Canada
Device: Lots and lots of electronic gadgets...
|
I reset it. It's empty. I have tried several times to add books from Calibre (with a factory reset and update each time) and still get the error messages. I had never had issues previously loading books to the Glo, nor do I have problems with my Mini (for which no firmware update will be supplied).
|
09-01-2020, 03:47 PM | #12 | |
Resident Curmudgeon
Posts: 74,375
Karma: 129333690
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
|
Quote:
Here is the link to the forum thread you'll need to read. https://www.mobileread.com/forums/sh...d.php?t=226719 Last edited by JSWolf; 09-01-2020 at 04:01 PM. |
|
09-01-2020, 06:20 PM | #13 | |
Connoisseur
Posts: 54
Karma: 10
Join Date: May 2010
Location: Oakville, ON, Canada
Device: Kobo Forma
|
Quote:
|
|
09-01-2020, 10:04 PM | #14 |
Grand Sorcerer
Posts: 24,906
Karma: 47303748
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
Sorry, that is bullshit. You have stated this before with no real evidence. I don't even think you bothered to mention what plugins you thought were causing the problem. Even the use of the plural for the plugins is a problem as there is only one that could even remotely be causing a problem. And even that is doubtful as 95% of the code used is actually in the built-in KoboTouch driver. Nearly all of the extra code acts on file on your computer before they are sent to the device.
|
09-01-2020, 10:35 PM | #15 | |||
Grand Sorcerer
Posts: 24,906
Karma: 47303748
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
Quote:
Quote:
Quote:
The firmware update is probably a coincidence. One of the things that happen is that the device is rebooted. If you don't do that very often, any issues with the database will come up at this point. You could try a factory reset. This will format the book partition and take you through the setup. If it is just a problem with file system, it will be fixed. If it is a problem with the card, it might temporarily fix it, but will probably happen again. |
|||
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Uploading Large Library to CC Taking Forever | dschnit1 | Calibre Companion | 23 | 07-29-2016 11:06 AM |
Calibre Newbie - Creating a library from a large collection of ebooks | Silanah | Library Management | 7 | 03-14-2016 05:19 PM |
Problems with large folders (with lots of files) such as book collection | rebl | General Discussions | 10 | 06-15-2015 04:37 AM |
Calibre- error uploading book to SD card | bratkat64 | Calibre | 12 | 12-06-2009 02:14 PM |
6.11 problem with adding large book collection | acekyoto | Calibre | 25 | 10-01-2009 12:25 PM |