FOSDEM 2017 note

FOSDEM 2017

Free and Open Source Software Developers' European Meeting

tuan t. pham

#Saturday, Febuary 4

##Software Heritage
Speaker: Stefano Zacchiroli, Roberto Di Cosmo

Software must written for people to read, and only incidentally for machine
to execute.

Think of it as Project Gutenberg of Human Written Software meets
WaybackMachine/Archive. Source for the Win!

Source code provides a view into the mind of the designer, Len Shustek.

##Sysdig
Analysing log data

/dev/null is available everywhere. Let's write to it. Clever Hack!

Tools: sysdig, csysdig

Source: https://github.com/draios/sysdig

##Backup and disaster Recovery
Bareos, ReaR, Relax and Recovery...etc.
Using scripts to take snapshot of the system and recover when disaster strike.

#Sunday, Febuary 5

##Scaling Graphite
At Booking.com, there are a lot of metrics to collect. In order to scope with
the large amount of data, the traditional Graphite software stack is redesigned
in order to scale. Vladimir Smirnov gives a brief
talk on how they did it.

###Initial Thought

Legacy Graphite Component New component
carbon-relay.py carbon-c-relay

carbon-c-relay: written in C, routes 1M data points per second using only 2
cores.

The key with scaling is that carbon-[c]-relay is Single Point Of Failure.
It's hard to scale when there are requirements of Fault-tolerance and High
Availability. So the team at Booking redesign the Graphite Stack using
carbonzipper, carbonserver, and go-carbon.

###Redesign the Graphite software stack

Legacy Graphite Component New component
carbon-cache.py carbonzipper + carbonserver + go-carbon

The beautiful new software stack looks like this:
ZipperStack

###SourceCode on github.com

Component URL
carbonzipper https://github.com/dgryski/carbonzipper
carbonserver https://github.com/grobian/carbonserver
carbonsearch https://github.com/kanatohodets/carbonsearch
go-carbon https://github.com/lomik/go-carbon
carbon-api https://github.com/dgryski/carbonapi
carbon-c-relay https://github.com/grobian/carbon-c-relay

Another thought: IPv6 on Android just works with Android 6.x version.

#Links

Title URL
FOSDEM 2017 https://fosdem.org/2017
Software Heritage API https://archive.softwareheritage.org/api
Software Heritage https://fosdem.org/2017/schedule/event/software_heritage/
Graphite at Scale https://fosdem.org/2017/schedule/event/graphite_at_scale/
Backup & Recovery https://fosdem.org/2017/schedule/track/backup_and_disaster_recovery/