read.cash Log in
@Giddyboy more from that month

This week, I paid the price for underestimating the power of technology. I wanted to download over 1000 files from a particular server for a project I am working on. The files aren’t accessible to the public but I and my team member found a workaround so we were able to access them via client server. Now came the real task, Downloading the files one by one. I first thought about using ftp tools but then I discovered I couldn’t download the files. It was as if the files were server-read-only. The second option was to write a download code, but since I assumed that the files were read only, I gave up trying to batch download them and started downloading them one by one through a google chrome extension Boy!!!! It was really a boring process. I was already at file 470 when my team member called that he has figured out a way to download them automatically. I was happy but very sad. I gave up sleep for the download process I said to myself. Apparently, he wrote a python tool that looped over the files in the directory we were downloading from, pulled the files we needed and then saved them to a local directory. Why didn’t I think of this I said to myself. Two lessons learnt for me. First, there’s always a way to do something automatically as long as it involves the internet. Second, always tell people you trust about your problems. They might have a handy solution for you.

14 comments

Log in to join in Reading is open to everyone. Replying needs an account.