Document Archive Migration

Document Archive Migration
The modular Document Genie Migration Platform

Need for Document Archive Migration

Many organizations that have vintage Electronic Document Archive(s) will have an incentive to update to newer Enterprise Content Management (ECM) software and storage systems. This is especially the case when end-of-life hardware, such as optical libraries, is used for archival storage. When moving to a different ECM platform, typically the need exists to migrate the unexpired legacy documents (scanned images, PDF documents, COLD reports, etc) and associated indexes to the new document archive. Format conversions, e.g. from AFP or Meta code to PDF may be required for the new environment as a part of Document Archive Migration process.

Whereas most platforms make it easy to ingest documents, there is typically no facility for the batch export of documents. Even when utilities or APIs exist to expose the data from the legacy archive, the available bandwidth is often not sufficient to make ‘online’ solutions feasible for all but the smallest archives.

  • Cost of media
  • Cost of maintenance
  • Disappearing vendor support
  • Expiring license agreement
  • High licensing fees
  • Technology obsolescence

Data Source

If the legacy archive uses a regular file system for storage, a copy can typically be provided on USB or NAS storage. Otherwise, we utilize production optical platters, back-up optical platters, back-up magnetic tapes or extract data from CAS systems, such as Centera. Additionally, we request a backup of the archive database, which can be a proprietary one or one of the regular SQL databases (Oracle, MS SQL, etc).

Format Conversions

Data Strategies has ample experience with the format conversion of the document formats that originated on IBM mainframes, such as all MODCA types, AFP/AFPDS and Xerox Meta code/DJDE. We can extract fonts and other resources from the corresponding libraries on the legacy systems (including iSeries / AS400). When PDF is the target format, legacy fonts are converted to Adobe type 1 fonts that are embedded in the PDF files, thus yielding documents with maximum semblance to the originals.

Annotations

Annotations can be extracted from the source archive and delivered in a format that is compatible with ingestion into the target archive. Alternatively, they can be “burned” directly into the image files or superimposed on PDF files.

Quality Assurance

All our migration and conversion processes are database driven. This allows for efficient QA procedures and complete process audit-trail creation. Automatic data format validation plays an important part in the overall quality control of the document archive migration process.

Data Delivery

The output documents and associated indexes are delivered on media of customer’s choice. Typically, we generate the control files or scripts that allow for the ingestion of the documents and associated indexes into the target archive. USB or NAS drives are nowadays the most common delivery media. However, we can also generate application specific data tapes, e.g. for mainframe target archives. The service of ingesting the documents in the target archive can be provided by Data Strategies, although typically this is handled by the client or by the provider of the new archive solution.

Architecture

All data migration services provided by Data Strategies Interchange are performed off-line using our proprietary technology that is the result of years of development in the area of legacy data archive conversion. Our conversion platform is characterized by a high degree of flexibility  to easily adapt to a broad range of conversion types and project size. It is also continuously expanded to support additional formats/systems.

Document Archive Migration Process

Given below are the steps taken by DSI to execute ASG ViewDirect projects successfully:

  1. Technical Assessment: This is done to identify specific version(s) of the legacy system, document archive configuration, indexes, annotations, forms, customer specified filter(s), and any other unique aspect of the conversion project.

  2. Customization and optimization: DSI modifies its proprietary tools for the conversion process based on the information collected during the technical assessment phase.

  3. Free Proof of Concept (POC): POC will be provided before taking any projects. During POC we ask our clients to provide a subset of the legacy data that needs conversion to validate the consistency of source data.

  4. Reception and inventory of the source data: Data to be converted and any collateral material (associated metadata, databases, and metadata) will be received by DSI.

  5. Conversion of data: Concurrent data migration using DSI’s proprietary tools on workstations specially optimized to perform large scale data migrations. The conversion process can include the filtering of documents based on customer-specified criteria.

  6. Quality Assurance: After the conversion process, DSI checks to see if all the data is migrated and in the expected format. Any errors or skipped data will be logged during the migration process. This data will undergo re-conversion if any special modification was needed, otherwise, it will be reported to the customer.

  7. Target data and migration report delivery: Once the migration is complete, DSI will deliver converted data and associated information (metadata, auxiliary files, databases, etc.) along with a detailed migration report to the client.

  8. Customer Support and relations: DSI strongly believes in maintaining good relations with clients. As a result, we always provide any additional information or help needed with the converted data anytime even after the migration is completed.

DSI's Approach

Based on Client’s preference, limitations, or security policies, DSI can provide the Document Archive Migration services for ASG ViewDirect using one of the following approaches:

OFFLINE MIGRATION​

Offline migration allows us to perform large-scale data migrations and conversions in the shortest time and the most cost-effective way at DSI's secure facility in Houston, TX.
This approach is favored by organizations with a moderate level of security where data can leave the premises. Furthermore, migration does not impact the client’s day-to-day operations.

ONSITE MIGRATION​

Onsite migration is performed at the client's physical location either on DSI's or client's infrastructure based on the requirements.
This approach is usually taken by customers with a tight level of security where migration and the data are strictly monitored.

REMOTE MIGRATION​

Remote access to the infrastructure is provided by the customer where DSI installs its proprietary tools needed for the migration.
This approach is typically taken by clients with a moderate level of security where data cannot leave the premises.

Supported Formats