• Scheduling scrapy spiders in Jenkins

  Oct 4, 2018

  

  If you haven’t figured how to run cron jobs to schedule your scrapy spiders, then I would suggest checking out my last post. And if you already figured how you would setup your Jenkins instance to run scrapy spiders then you can stop reading now. But if you would like to read up on how to configure your Jenkins job to pull in your scrapy project from github then please keep reading.

  Continue Reading...

• Periodically running python programs

  Apr 23, 2018

  

  When I learned to program, one of the things I wanted to do was run tasks, jobs, functions, programs etc. on a periodic basis. On my journey with python I learned that there are multiple techniques to accomplish this. I learned that I could run a program in the background in the command line or run it as a cron. There are also a combination of python packages that are available which can be useful in running background tasks. I will try to walk to some of them during this post. Forewarning, this is a long post so if you would like to put a pin in it and comeback later, I totally understand. I will try and break in down in multiple posts so it’s easier to come back to. For beginners to python and Unix I would recommend reading the whole series in order to get an idea of working with periodic tasks in python or Unix environments.

  Continue Reading...

• Happy New Year! Another year in review

  Jan 29, 2018

  

  Happy new year everyone! How was 2017? I myself had a heck of a time. I wanted to share some lessons and experiences I learned during the year.

  Continue Reading...

• Evolution of containers

  Dec 5, 2017

  

  I know, I am a little late to chime in on this discussion on the evolution of containers but, lately I have been fascinated in learning how we started using Docker for software deployments. Surely there must have been other inputs in the creation of virtual environments. So I started reading, and went down a rabbit hole to find some answers.

  Continue Reading...

• Installing linux on my chromebook - The Acer...

  Nov 26, 2017

  

  Happy Thanksgiving everyone! For this Black Friday I purchased a new chromebook from Acer for $149. I have been looking for something in a light weight laptop department. This one weighs less than 3 lbs and lasts for 8 hours on a single charge. I was more than happy to carry a basic chromebook than a bulky laptop. The only issue was running something other than ChromeOS since I wanted to do more than just browse the internet.

  Continue Reading...