Saturday, May 19, 2012

Writing a thesis on multiple computers

While researching about the principles of constructing tactile orientation maps (semi)automatically I have built my own data storage infrastructure that synchronizes my files and data to multiple computers.  The background is that I work from different sites with different computers, some of which are always online, some of them at least partially offline (for example when I ride the train).

First, I installed Zotero, the reference gathering and management tool, as extension to Firefox. The reference data and some files attached to references are stored locally on the computer such that one can work offline. Originally intended for installation on a single computer Zotero can be tweaked to work on multiple computers (each one has to be assigned a unique ID via the Firefox configuration), such that all synchronize with the same reference collection and the same file storage. I originally used the GMX MediaCenter as WebDAV backend for file storage which worked fine until recently. In April 2012 there was some unannouced change in the GMX policies that restrict folder sizes to 1000 files (see this help page). As Zotero stores all file attachments non-hierachically in one folder and as each attachment has an additional property file this restriction means that you can only store 500 attachments. My collection of references has well above 1000 items, thus GMX MediaCenter does not work for me anymore. I am in search of a replacement offering at least 3GB of storage over WebDAV. I tried Microsoft Skydrive (7GB but no WebDAV) and T-Online Mediencenter (25GB but no WebDAV) as storage provider and SME Storage as WebDAV interface to these providers and my own FTP server. But I haven't found a working solution yet even if there are great website to compare cloud storage solutions (often other solutions have the 1000 files limit as well or a transfer limit of less than 2GB). If someone knows one for not more than 50Euros/year, please point me to that solution!

Working on my thesis, I found that the cloud storage services Dropbox and Wuala are pretty useful when you work at different places with different computers. I particularly like Wuala. It is a European service, offers real client-side encryption and a non-hierarchical embedding of sync-folders into the local file system. Even if encrypted in the cloud most services suffer from some security issues as the recent report "On the Security of Cloud Storage Services" (in German) by the Fraunhofer SIT turned up. I would like to have my data on my own server, but this will be done only after I have finished my thesis. Then I will setup some own WebDAV server that can hold my attachments of my Zotero library, all my photos etc. that are now distributed over different cloud services.

Having worked on a heterogenous infrastructure in the past including different operation systems (Windows, MacOS) and different word processors (Word, OpenOffice, LaTeX), I needed some tool to convert from DOC and RTF files including tables and figures to TeX files. This page about free and commercial coverters on TUG.org helped my a lot.

4 comments:

  1. Zotero users (many of them encountering the same 1000 file issue you did) have reported very good experiences with cloudme:
    http://www.cloudme.com/en/features/packages
    It's free up to 3GB and 49$ for up to 25GB.

    ReplyDelete
  2. Thanks for pointing me to CloudMe. Unfortunately they allow only 25MB per file. This is another limitation that would not work for me as I have some files archives with size 50-150MB. :(

    ReplyDelete
  3. Oh, I have just learned from the cloudme.com twitter stream that they increased the per file limit to 150MB. Wonderful!

    ReplyDelete
  4. According to one of their answers in their twitter stream the WebDAV-URL for usage in Zotero is something like "http://webdav.cloudme.com/username/xios/zotero". Seems to be great support. I will definitely give it a try, even if they do not offer secured connections. But at least they are EU based (in Sweden).

    ReplyDelete