Prometheus and Grafana setup
This guide shows how to configure Prometheus and Grafana to monitor ngit-grasp.
Prerequisites
- ngit-grasp running with metrics enabled (default:
--metrics-enabled true) - Prometheus server
- Grafana (optional, for dashboards)
Verify Metrics Endpoint
First, verify that ngit-grasp is exposing metrics:
bash
curl http://localhost:7334/metricsYou should see Prometheus-formatted metrics like:
# HELP ngit_websocket_connections_active Current active WebSocket connections
# TYPE ngit_websocket_connections_active gauge
ngit_websocket_connections_active 5
# HELP ngit_git_operations_total Git operations by type and status
# TYPE ngit_git_operations_total counter
ngit_git_operations_total{operation="clone",status="success"} 42NixOS Configuration
Prometheus
Add ngit-grasp as a scrape target:
nix
services.prometheus = {
enable = true;
scrapeConfigs = [
{
job_name = "ngit-grasp";
static_configs = [{
targets = [ "localhost:7334" ]; # ngit-grasp bind address
}];
scrape_interval = "15s";
metrics_path = "/metrics";
}
];
};Grafana with Prometheus Datasource
nix
services.grafana = {
enable = true;
settings.server.http_port = 3000;
provision.datasources.settings.datasources = [{
name = "Prometheus";
type = "prometheus";
url = "http://localhost:9090";
isDefault = true;
}];
# Optional: provision the ngit-grasp dashboard
provision.dashboards.settings.providers = [{
name = "ngit-grasp";
options.path = "/path/to/ngit-grasp/docs/grafana";
}];
};Docker Compose Configuration
For non-NixOS deployments:
yaml
version: '3.8'
services:
prometheus:
image: prom/prometheus:latest
volumes:
- ./prometheus.yml:/etc/prometheus/prometheus.yml
ports:
- "9090:9090"
grafana:
image: grafana/grafana:latest
ports:
- "3000:3000"
volumes:
- ./docs/grafana:/var/lib/grafana/dashboards
environment:
- GF_DASHBOARDS_DEFAULT_HOME_DASHBOARD_PATH=/var/lib/grafana/dashboards/ngit-grasp-dashboard.jsonWith prometheus.yml:
yaml
global:
scrape_interval: 15s
scrape_configs:
- job_name: 'ngit-grasp'
static_configs:
- targets: ['host.docker.internal:7334'] # or your ngit-grasp host
metrics_path: /metricsImport Dashboard
- Open Grafana at
http://localhost:3000 - Go to Dashboards → Import
- Upload
docs/grafana/ngit-grasp-dashboard.json - Select your Prometheus datasource
- Click Import
Key Metrics to Monitor
Connection Health
ngit_websocket_connections_active- Current active connectionsngit_websocket_unique_ips- Number of unique client IPsngit_websocket_flagged_abusers- IPs exceeding connection threshold
Git Operations
ngit_git_operations_total- Operations by type (clone/fetch/push) and statusngit_git_bytes_total- Bandwidth by direction (in/out)ngit_git_top_repos_bytes- Top N repositories by bandwidth
Nostr Events
ngit_events_received_total- Events received by kindngit_events_stored_total- Events successfully storedngit_events_rejected_total- Events rejected by reason
System
ngit_uptime_seconds- Server uptimengit_build_info- Version and commit infongit_repositories_total- Total hosted repositoriesngit_cgroup_cpu_seconds_total- Cumulative CPU time used by ngit-grasp and its child Git processes; userate(ngit_cgroup_cpu_seconds_total[5m])for total service CPU cores consumed over timengit_cgroup_memory_current_bytes- Current memory used by ngit-grasp and its child Git processesprocess_cpu_seconds_total- Cumulative CPU time used by the ngit-grasp process; userate(process_cpu_seconds_total[5m])for CPU cores consumed over timeprocess_resident_memory_bytes- Resident memory used by the ngit-grasp processprocess_virtual_memory_bytes- Virtual address space used by the processprocess_threads- Number of operating-system threads in the processprocess_open_fds/process_max_fds- Current and maximum file descriptors
Use the ngit_cgroup_* metrics as the headline service resource measurements. The process_* metrics exclude child Git processes and are useful for separating daemon resource usage from Git work. Cgroup metrics are omitted when ngit-grasp is not running in a readable Linux cgroup v2 hierarchy.
Example Alerts
Add to your Prometheus alerting rules:
yaml
groups:
- name: ngit-grasp
rules:
- alert: HighConnectionCount
expr: ngit_websocket_connections_active > 100
for: 5m
labels:
severity: warning
annotations:
summary: "High number of WebSocket connections"
- alert: AbusiveIPs
expr: ngit_websocket_flagged_abusers > 0
for: 1m
labels:
severity: warning
annotations:
summary: "{{ $value }} IPs flagged for excessive connections"
- alert: PushAuthorizationFailures
expr: rate(ngit_git_operations_total{operation="push",status="denied"}[5m]) > 0.1
for: 5m
labels:
severity: info
annotations:
summary: "Elevated push authorization failures"See Also
- Monitoring Overview - Architecture and design
- Configuration Reference - All config options