Kibanr

Photo by Christopher Burns on Unsplash.

kibanr was born of a need to understand how users interact with the Atlas of Living Australia (APIs). The most useful data comes from NGINX logs, which, using the ELK stack, are parsed and visualised in Kibana. The high volume of logs means that raw logs are kept for less than 3 months. To understand usage trends over time, there was therefore a need to pull summary statistics from Kibana on a monthly basis. Using R to pull the data was an interesting challenge, given the requests and responses are in JSON, and python would probably have been an easier choice.

Avatar
Matilda Stevenson
Full-Stack Data Analyst

Related