con/tinuous
·3 mins
Multi-platform CI log and artifact archival tool with DataLad integration, secret sanitization, and stateful incremental fetching.
Code Artifacts
A git repository preserves source code, but the surrounding context –
issues, pull requests, code reviews, discussions, and wiki pages –
lives on the forge platform and is not captured by git clone.
When a project migrates between forges, or a forge shuts down, this context is often lost. The tools in this section extract these artifacts so they can be archived alongside the code they describe.
Artifact Types #
Issues and Pull Requests – Bug reports, feature requests, and code review threads. git-bug stores them as distributed git objects; github-backup exports them as JSON.
Discussions – Forum-style threads (GitHub Discussions, GitLab forums). gh-discussions-export captures these for offline access.
Wikis – Project documentation hosted on the forge. gh-md backs up GitHub markdown content including wikis.
Crawled Resources – Broader web resources associated with a project. datalad-crawler provides a DataLad-native approach to tracking and versioning web-hosted resources.
Why Archive Code Artifacts? #
Code artifacts carry institutional knowledge: the why behind design decisions, the history of bugs and their fixes, and community discussions that shaped the project. This context is often more valuable than the code itself for understanding and reproducing research software.
Archiving code artifacts also enables AI-assisted development workflows – an LLM with access to the full issue history can provide significantly better code review and bug analysis.
datalad-container
·3 mins
Integrates Docker and Singularity/Apptainer container images into DataLad datasets, enabling reproducible computational workflows where both data and execution environments are version-controlled.
datalad-crawler
A DataLad extension that provides pipeline-based web crawling for systematically tracking and archiving web resources into DataLad datasets.
gh-md
A tool for backing up GitHub wiki pages and markdown documentation into local files for archival and offline access.
git-bug
·3 mins
A distributed, offline-first bug tracker that stores issues directly in git refs, with bidirectional bridges to major issue trackers.
GitHub Discussions Export
Tools for exporting GitHub Discussions – threaded Q&A and community conversations – into portable markdown and JSON formats.
python-github-backup
A Python tool that creates comprehensive backups of GitHub repositories and their metadata – issues, PRs, releases, wikis, stars, and more.