Bot SAC Overview
Infrastructure of OSGeo System Administration Committee (SAC)
Presentation: OSGeo Service Infrastructure Overview
This document outlines a proposed 12-slide presentation for the OSGeo leadership. The focus shifts from specific hardware inventory to the value, reliability, and strategic benefit of the services provided to the community.
Slide 1: Introduction
Title: Empowering the Open Geospatial Community: OSGeo Infrastructure Overview
Content:
Presenter: SAC Infrastructure Team Objective: To provide a high-level overview of the technical infrastructure supporting OSGeo projects. Key Message: Our infrastructure is not just about servers; it is about enabling collaboration, development, and community engagement for the global open-source geospatial movement. Scope: Overview of core services, hosting strategies, and future resilience.
Slide 2: Strategic Vision & Philosophy
Title: From Hardware to Service-Oriented Infrastructure
Content:
The Shift: Moving away from "managing servers" to "delivering services."
Core Principles:
Reliability: High availability for critical community tools.
Scalability: Flexible resources to support growing projects (e.g., Docker, CI/CD).
Security: Robust access controls and data protection.
Community-Centric: Infrastructure tailored to the needs of GIS developers, researchers, and users.
Goal: A unified, resilient platform that allows project teams to focus on code and content, not sysadmin tasks.
Slide 3: The Foundation: Modern Virtualization
Title: Efficient Resource Utilization via LXD/Incus
Content:
Technology Stack: Migration to modern containerization (LXD/Incus) and virtualization.
Benefits:
Density: More services per physical machine, reducing energy and hardware costs.
Isolation: Secure separation of projects (e.g., Nextcloud vs. Jenkins).
Speed: Rapid deployment and cloning of environments for testing and production.
Current State: Primary hosts (osgeo4, osgeo7, osgeo8, osgeo9, osgeo10) form a robust, distributed cluster.
Slide 4: Core Web Presence & Community Hub
Title: The OSGeo Website & Wiki Ecosystem
Content:
Services:
www.osgeo.org: The main portal for news, events, and project listings.
wiki.osgeo.org: The central knowledge base for documentation and community guides.
Infrastructure:
Hosted on modern LXD containers (osgeo6/osgeo7).
Automated deployments via Ansible ensure consistency and easy updates.
Staging environments (wordpress-dev, wiki-staging) allow safe testing before production release.
Benefit: A stable, up-to-date face of OSGeo for millions of visitors.
Slide 5: Communication & Collaboration Tools
Title: Keeping the Community Connected
Content:
Real-Time Chat:
Matrix (gitter/irc bridges): Secure, federated chat for developer discussions.
Heisenbridge: Bridges IRC channels to Matrix for broader accessibility.
Video Conferencing:
Jitsi Meet (meet.osgeo.org): Self-hosted, privacy-focused video meetings for SAC and project meetings.
Mailing Lists:
Mailman (lists.osgeo.org): The backbone of asynchronous communication for announcements and technical debates.
Benefit: Diverse, accessible, and self-hosted communication channels that respect user privacy.
Slide 6: Development & Continuous Integration
Title: Powering Project Development with CI/CD
Content:
Code Hosting:
Gitea (git.osgeo.org): Lightweight, self-hosted Git service for project repositories.
Continuous Integration:
Jenkins (host.postgis.net & osgeo10): Automated testing and building for major projects like PostGIS and GRASS GIS.
Dronie: Automated release management and build coordination.
Benefit: Accelerates development cycles, ensures code quality, and automates the release process for critical geospatial software.
Slide 7: Data Management & Storage
Title: Secure Data Sharing and Distribution
Content:
File Sharing:
Nextcloud (nextcloud.osgeo.org): Secure, self-hosted cloud storage for project teams and sensitive data.
Photoprism: AI-powered photo management for community events and galleries.
Software Distribution:
Download Server (download.osgeo.org): High-bandwidth mirror for OSGeo Live, ISOs, and project binaries.
Repo Server (repo.osgeo.org): Centralized repository for Debian/Ubuntu packages and Docker images.
Benefit: Reliable access to software and data for users worldwide, with secure internal collaboration tools for teams.
Slide 8: Project-Specific Hosting & Specialized Services
Title: Supporting Diverse Project Needs
Content:
GRASS GIS: Dedicated hosting (grass.osgeo.org) with automated website generation and security updates. GeoServer: Certification testing environment (cite.geoserver.org) and demo instances. QGIS: Separate, high-performance hosting for QGIS project needs (website, docs, plugins). LimeSurvey: Self-hosted survey tool for community feedback and elections. Benefit: Tailored infrastructure that meets the unique technical requirements of different projects, from heavy compute to simple web hosting.
Slide 9: Monitoring, Security & Reliability
Title: Proactive Maintenance and Security
Content:
Monitoring:
Prometheus & Grafana (monitor.osgeo.org): Real-time visibility into server health, container metrics, and service status.
Automated alerts for SAC administrators.
Security:
LDAP Integration: Centralized identity management for secure access.
SSH Key Management: Strict key-based access control with jump hosts for isolation.
Regular Updates: Automated security patches (unattended-upgrades) and regular OS upgrades.
Benefit: Proactive identification of issues, ensuring high uptime and protecting community data.
Slide 10: Disaster Recovery & Backup Strategy
Title: Ensuring Business Continuity
Content:
Backup Infrastructure:
Dedicated backup hardware (osgeo5) for critical data.
Rsync backups for download mirrors.
Bacula backups for VMs and containers.
Redundancy:
Distributed hosting across multiple physical machines.
Regular restoration tests to verify backup integrity.
Benefit: Peace of mind knowing that community data and project history are protected against hardware failure or accidental deletion.
Slide 11: Future Roadmap & Optimization
Title: Evolving Infrastructure for Future Growth
Content:
Consolidation: Migrating remaining legacy services to modern LXD/Incus hosts. Performance: Optimizing network proxies (Nginx) and storage (ZFS) for better throughput. Expansion: Preparing for increased demand from growing projects (e.g., more CI/CD agents, larger download mirrors). Sustainability: Reducing physical footprint through efficient virtualization. Benefit: A forward-looking infrastructure that is cost-effective, efficient, and ready for the next decade of open geospatial innovation.
Slide 12: Conclusion & Q&A
Title: Summary and Next Steps
Content:
Summary:
OSGeo infrastructure is a robust, modern, and community-focused platform.
It supports a wide range of services from web hosting to complex CI/CD pipelines.
Continuous improvement ensures reliability and security.
Call to Action:
Support for ongoing maintenance and potential upgrades.
Collaboration between SAC and project teams to identify future needs.
Q&A: Open floor for questions and discussion.
Notes for Presentation Delivery
Emphasis on Benefit: When discussing each slide, always link the technical detail back to the user or project benefit (e.g., "This Jenkins server means faster releases for PostGIS users"). Visuals: Use diagrams showing the flow from user -> web proxy -> container -> service. Show screenshots of the monitoring dashboard to demonstrate proactive management. Simplicity: Avoid deep technical jargon where possible. Focus on concepts like "reliability," "speed," and "security." Addressing Mistakes: The original document contained outdated information (e.g., osgeo3 status, specific container names). This presentation uses the corrected, high-level view to avoid confusion. Ensure the slide deck reflects the current state as described in the revised service list.