Type: New Feature
Status: Closed - Won't Fix
Affects Version/s: None
Fix Version/s: None
Component/s: Bigdata Federation
Bigdata has extensive performance counters which are self-reported by the various services using NanoHTTP and also aggregated to the load balancer. In turn, the load balancer provides a NanoHTTP interface which may be used to create interesting views, and in some cases, visualizations, of the aggregated performance counters.
Historically, we have used Excel worksheets with tabs dedicated to the different performance counters (CPU Utilization, IO Wait, toldTriplesLoadedPerSec, etc). Each tab has one or more http queries which draw down the relevant performance counters, populate a table in Excel, and then update a graph linked to that table. Those worksheets are in src/resources/analysis.
This works but is platform specific. In some cases it is also specific to the name of a monitored job or the namespace of a triple store. A more flexible solution could be easily assembled using a web application which issues these queries and then paints the page in the browser. A little logic in the web application would make it possible to monitor specific jobs or namespaces in the database.
Create a web application per the description above to provide more flexible performance monitoring.