Governed Archival Collections — Accessioning, Description, Preservation, and Public Access — on AWS Infrastructure with Cost-Optimised Long-Term Storage
Archives and collections management is a distinct discipline from document management and records management. Archivists don't manage documents in active business use — they manage materials of enduring value that have been selected for permanent or long-term preservation. The materials may be institutional records, historical correspondence, photographs, manuscripts, audiovisual recordings, research data, or digital-born content. The governance requirements are different: provenance and original order must be maintained; descriptive standards (ISAD(G), DACS, RAD, EAD) must be followed; access may be restricted by donor agreements, privacy legislation, or sensitivity reviews; and preservation must span decades or centuries, not just regulatory retention periods.
Most archival institutions manage their collections using a patchwork of archival management software, shared drives, physical storage inventories, and finding aids maintained in separate systems. Digital collections — particularly born-digital materials and digitised surrogates — sit in storage without the governance controls that physical collections receive. The result: physical archives are professionally managed but digitally fragile, while digital archives are technically durable (if stored well) but professionally ungoverned.
FormKiQ provides a governed document management layer for digital archival collections — deployed into your own AWS account, with descriptive metadata, access control, preservation storage, and discovery capabilities designed for archival requirements. FormKiQ doesn't replace archival management software for physical collections — it provides the governed digital repository that archival programmes need for born-digital materials, digitised surrogates, and the digital components of hybrid collections.
Archives vs. Document Archives vs. Records Management
These three disciplines overlap but serve different purposes. Understanding the distinctions matters for selecting the right governance model:
| Records Management | Document Archives | Archives and Collections | |
|---|---|---|---|
| Purpose | Governance — retention enforcement, legal hold, defensible disposition | Cost-optimised preservation of inactive documents | Permanent preservation of materials of enduring value |
| Selection | All records subject to retention schedule — inclusion is mandatory | Documents past active use but requiring preservation | Materials selected for enduring historical, evidential, or cultural value — inclusion is curatorial |
| Duration | Defined by retention schedule — years, sometimes decades | Cost-driven — keep as long as needed at lowest cost | Permanent or very long-term — decades to centuries |
| Organisation | By records series, document type, and retention category | By business function, department, or source system | By provenance and original order — respect des fonds |
| Description | Metadata schemas driven by business requirements | Metadata driven by search and retrieval needs | Archival description standards (ISAD(G), DACS, RAD, EAD) |
| Access | Role-based and attribute-based business access | Business access for reference and production | Researcher access governed by donor agreements, privacy restrictions, and sensitivity review |
| Disposition | Destruction, transfer, or preservation per retention schedule | Transition to lower-cost storage or eventual disposition | No disposition — materials are preserved permanently |
The Archival Lifecycle
FormKiQ supports each stage of the archival lifecycle for digital materials:
| Archival Stage | What Happens | FormKiQ Governance |
|---|---|---|
| Appraisal | Materials assessed for enduring value — selected for acquisition or transfer to the archive | Appraisal documentation stored as part of the accession record; selection criteria documented |
| Accessioning | Materials formally received into the archive — provenance documented, donor agreements executed, initial inventory created | Accession workflows; donor agreement management with eSignature; accession metadata (source, date, conditions, restrictions) |
| Arrangement | Materials organised according to archival principles — respect des fonds, original order maintained | Hierarchical metadata supporting fonds → series → file → item structure; original order preserved through metadata rather than physical reorganisation |
| Description | Materials described according to archival standards to enable discovery | Metadata schemas supporting ISAD(G), DACS, RAD, and EAD elements; multi-level description (collection, series, file, item) |
| Preservation | Materials stored for long-term preservation — digital integrity maintained over time | Amazon S3 with eleven-nines durability; format-agnostic storage; integrity checksums; archival storage tiers (Glacier) |
| Access and discovery | Researchers and the public discover and access materials through finding aids and search | Full-text and metadata search; access controls enforcing donor restrictions, privacy embargoes, and sensitivity restrictions |
| Reference | Archivists respond to reference requests — identifying and producing materials for researchers, institutions, or legal proceedings | Search and retrieval across collections; citation-level reference; reproduction request tracking |
Archival Description Standards
FormKiQ's metadata architecture supports archival description standards through configurable schemas:
Multi-Level Description
Archival materials are described at multiple levels — from the collection as a whole down to individual items. FormKiQ supports hierarchical description:
| Level | What It Describes | Example |
|---|---|---|
| Fonds | The entire body of materials from a single creator | "Smith Manufacturing Company fonds, 1923–1987" |
| Series | A group of materials within the fonds organised by function or form | "Board of Directors meeting minutes, 1945–1987" |
| File | A group of related items within a series | "Board meeting file — 12 March 1967" |
| Item | A single document or object | "Minutes of the Board of Directors meeting, 12 March 1967" |
Standard Descriptive Elements
FormKiQ's metadata schemas can be configured to capture the descriptive elements required by major archival standards:
| Descriptive Element | ISAD(G) | DACS | RAD | FormKiQ Implementation |
|---|---|---|---|---|
| Reference code | 3.1.1 | — | 1.8B | Metadata field: unique identifier within the institution's reference system |
| Title | 3.1.2 | 2.3 | 1.1B | Metadata field: title of the unit of description |
| Date | 3.1.3 | 2.4 | 1.4B | Metadata fields: date range (start, end), date type (creation, accumulation) |
| Extent | 3.1.5 | 2.5 | 1.5B | Metadata fields: quantity, unit of measurement (items, pages, MB/GB) |
| Creator | 3.2.1 | 2.6 | 1.7B | Metadata field: creating entity; linked to authority record |
| Scope and content | 3.3.1 | 3.1 | 1.7D | Metadata field: free-text description of the content |
| Conditions of access | 3.4.1 | 4.1 | 1.8D | ABAC rules: access restrictions encoded as metadata driving access control policies |
| Custodial history | 3.2.3 | 5.1 | 1.7C | Metadata field: provenance chain from creation through custody to archival acquisition |
| Finding aids | 3.4.5 | 4.6 | 1.8B12 | Generated documents: finding aids produced from hierarchical metadata and descriptive records |
Donor Agreement and Access Restriction Management
Archives frequently acquire materials under donor agreements that specify access restrictions — embargoes, privacy restrictions, sensitivity restrictions, or conditions on reproduction. Managing these restrictions over decades is a core archival challenge:
| Access Restriction Type | How It Works | FormKiQ Enforcement |
|---|---|---|
| Embargo period | Materials restricted from public access for a defined period (e.g., 25 years from creation, 10 years from donation) | Temporal access rules: restriction metadata with expiry date; access automatically opens when the embargo expires |
| Privacy restriction | Materials containing personal information restricted per privacy legislation or donor conditions | Sensitivity classification; ABAC restricting access to authorised archival staff; researcher access subject to approval |
| Donor restriction | Specific conditions imposed by the donor — access limited to certain researchers, prohibited for certain purposes, or requiring donor approval | ABAC rules encoding donor conditions; approval workflows for researcher access requests |
| Sensitivity restriction | Materials containing culturally sensitive, legally privileged, or security-classified content | Sensitivity metadata driving ABAC policies; access review workflows; periodic declassification review |
| Copyright restriction | Materials subject to copyright limitations on reproduction and distribution | Copyright status metadata; reproduction request workflows; rights management documentation |
Digital Preservation
Long-term preservation of digital materials requires durable storage, integrity verification, and format management. FormKiQ provides the storage and integrity layer; specialised digital preservation tools handle format migration and characterisation:
Storage Durability and Cost
| Preservation Need | AWS Capability | FormKiQ Implementation |
|---|---|---|
| Durability | S3 provides 99.999999999% (eleven nines) durability | Every digital object stored in S3 with automatic redundancy across multiple facilities within the region |
| Integrity | S3 object checksums and integrity verification | Checksums recorded at ingest and verified periodically; integrity failures flagged for remediation |
| Cost-optimised storage | S3 Glacier and Glacier Deep Archive for long-term preservation | Archival collections transition to Glacier tiers based on access frequency — reducing cost by up to 95% while maintaining durability |
| Format-agnostic storage | S3 stores any file format without conversion | Original digital objects preserved in their native format; preservation copies stored alongside originals where format migration is performed |
Integration with Digital Preservation Tools
FormKiQ is designed to complement, not replace, specialised digital preservation tools:
- Archivematica — FormKiQ can serve as the storage and access layer for materials processed through Archivematica's digital preservation pipeline
- Preservica — FormKiQ provides governed access and discovery for materials preserved in Preservica
- DROID / PRONOM — format identification results from DROID can be stored as metadata in FormKiQ for format management
- BagIt — materials packaged using the BagIt specification can be ingested into FormKiQ with bag metadata preserved
Discovery and Access
Archival materials are only valuable if they can be found. FormKiQ provides discovery and access mechanisms for researchers, the public, and institutional users:
| Discovery Capability | Description |
|---|---|
| Full-text search | Search across the full text of digitised and born-digital materials — powered by Amazon OpenSearch |
| Metadata search | Search by any descriptive element — creator, date range, subject, extent, reference code |
| Hierarchical browsing | Navigate collections through the fonds → series → file → item hierarchy |
| Finding aid generation | Document Generation module produces finding aids from hierarchical metadata and descriptive records |
| Public access portal | API-driven access supporting public-facing discovery interfaces; access controls enforcing restrictions transparently |
| Researcher request management | Workflows for researcher access requests, approval, and access provisioning — with audit trail |
Who Uses Archives and Collections Management on AWS
| Institution Type | Archival Needs | Key Drivers |
|---|---|---|
| University and research libraries | Institutional archives, special collections, research data archives, manuscript collections | Research access, institutional memory, donor relations, accreditation |
| National and state/provincial archives | Government records of enduring value, historical collections, public access programmes | Statutory archival mandates, public accountability, cultural preservation |
| Museums | Collection documentation, exhibition records, provenance documentation, digitised collection access | Collection governance, provenance research, public engagement, donor requirements |
| Corporate archives | Institutional records, brand heritage, historical product documentation, executive correspondence | Corporate memory, brand management, litigation reference, anniversary and heritage programmes |
| Religious and cultural organisations | Community records, sacramental registers, historical correspondence, cultural heritage materials | Community identity, genealogical research, cultural preservation |
| Healthcare institutions | Historical patient records, institutional records, medical research archives | Historical research, institutional memory, regulatory reference |
| Foundations and philanthropic organisations | Grant history, programme records, founder and donor archives, institutional documentation | Institutional memory, donor stewardship, programme reference, accountability |
| Media organisations | News archives, photographic collections, broadcast recordings, production records | Content reuse, rights management, institutional history, legal reference |
FormKiQ Editions for Archives and Collections Management
| Capability | Core | Essentials | Advanced | Enterprise |
|---|---|---|---|---|
| Document Storage (S3) & API | ✓ | ✓ | ✓ | ✓ |
| Tagging, Search & Classification | ✓ | ✓ | ✓ | ✓ |
| OCR (Tesseract) | ✓ | ✓ | ✓ | ✓ |
| OCR & IDP (Textract) | ✓ | ✓ | ✓ | |
| SSO (SAML — Entra, Google, Auth0) | ✓ | ✓ | ✓ | |
| Workflows, Queues & Rulesets | ✓ | ✓ | ✓ | |
| Encryption (KMS — in-transit & at-rest) | ✓ | ✓ | ✓ | |
| Document Control & Versioning | ✓ | ✓ | ✓ | |
| AI Processing & Analysis (Bedrock) | ✓ | ✓ | ||
| Document Generation (finding aids) | ✓ | ✓ | ||
| eSignature (donor agreements) | ✓ | ✓ | ||
| Document Gateway Modules | ✓ | ✓ | ||
| Enhanced Full-Text Search (OpenSearch) | ✓ | ✓ | ||
| Solution Layers (Archives & Collections) | ✓ | ✓ | ||
| Multi-Instance & Multi-Region Licensing | ✓ | ✓ | ||
| Vendor-Managed & Hybrid Deployment | ✓ | |||
| Custom SLAs & Compliance Consulting | ✓ | |||
| Support | Community | 2-business-day SLA | Private Slack + 40 hrs onboarding | 8-business-hour SLA + strategic support |
Deployment Models
| Model | Description | Availability |
|---|---|---|
| Customer-Managed AWS | Deploys directly into your AWS account via CloudFormation. Full control of infrastructure, networking, encryption keys, and operations. | All editions |
| Vendor-Managed | FormKiQ manages the AWS infrastructure on your behalf — deployment, updates, and operational support. | Enterprise |
| Hybrid | You retain control of specific components (encryption keys, network config) while delegating operational management to FormKiQ. | Enterprise |
Every deployment is a dedicated, isolated instance. FormKiQ does not operate a shared multi-tenant environment.
Getting Started
FormKiQ Core can be deployed to your AWS account in fifteen to twenty minutes. Archives and collections management capabilities — including AI-powered description, finding aid generation, donor agreement management, and archival-standard metadata schemas — are available on FormKiQ Advanced and Enterprise.
Frequently Asked Questions
How is archives and collections management different from document archiving?
Document archiving is about cost-optimised storage of inactive business documents with retention enforcement. Archives and collections management is a professional discipline focused on the permanent preservation of materials of enduring value — with requirements around provenance, original order, archival description standards, donor restrictions, and long-term public access. FormKiQ supports both within the same platform, but the governance models are different.
Does FormKiQ support ISAD(G), DACS, and RAD descriptive standards?
FormKiQ's metadata schemas are configurable to capture the descriptive elements required by ISAD(G), DACS, RAD, and other archival standards. Multi-level description (fonds, series, file, item) is supported through hierarchical metadata. Finding aids can be generated from descriptive metadata using the Document Generation module. FormKiQ provides the structured metadata infrastructure — archivists configure the schemas to match their institution's descriptive practices.
How does FormKiQ handle donor-imposed access restrictions?
Donor restrictions are encoded as metadata on the affected materials, driving ABAC access policies. Embargoes with defined expiry dates are enforced temporally — access opens automatically when the embargo period ends. Donor-approval-required restrictions are enforced through access request and approval workflows. All access to restricted materials is audit-logged.
Can FormKiQ work alongside existing archival management software?
Yes. FormKiQ provides the governed digital repository — storage, access control, metadata, search, and preservation storage — while existing archival management software (ArchivesSpace, Atom, Archivematica) continues to manage physical collections, process digital materials, and produce descriptive outputs. The two systems are complementary.
How does FormKiQ handle preservation of digital materials?
FormKiQ stores digital objects in Amazon S3 with eleven-nines durability, integrity checksums, format-agnostic storage, and cost-optimised archival tiering (Glacier). For format migration and digital preservation processing, FormKiQ integrates with specialised tools like Archivematica. FormKiQ provides the durable, governed storage and access layer; preservation tools handle format characterisation and migration.
How much does long-term archival storage cost on AWS?
S3 Glacier Deep Archive — suitable for materials accessed rarely or never but requiring permanent preservation — costs approximately 95% less than standard S3 storage. For large archival collections measured in terabytes, this translates to storage costs of a few dollars per terabyte per month — a fraction of the cost of on-premises storage infrastructure with comparable durability.