Release Notes

Get details on new features, changes, and bug fixes for each Platform and toolkit release.

Release for 01-Jul-2025

• Security patching for Docker containers

• Interoperable Omics Data Fabric (Data Catalog) release

• Expansion of the Cohort Browser to include multi-assay support, somatic data querying and visualization support, and gene expression data querying and visualization support

• Trust Research Environment offering

• Apollo: updates of JDK 11 and dxpark 3.5.2 packages, fix for the Pearson coefficient in scatterplots

Release for 17-Jun-2025

• Security patching of Docker containers

• TRE updates to accomodate application reviews

• Bug fixes in the user interface

• Apps: Updates of REGENIE to v2.1.0, regenie_test_associations to v2.1.0 and regenie_fit_wgr to v2.1.0

• Apollo: Fix statistics output in histogram API and for multi-assay datasets

Release for 10-Jun-2025

• Security patching of EC2 instances and Docker containers

• Bug fixes for writable symlinks, user interface, S3 deletions, and handling of unharvested containers

• Updates to TREs for support of multi-port https apps

• Updates to support new GPUs (not available in all regions)

• Cohort Browser: updates of the user interface about tables

• Apollo: internal upgrades to latest JDK and spark pages, implementation of expression locks for internal queries used in boxplot, histogram and scatterplot API and updates to the Pearson correlation coefficient in scatterplot API.

Release for 03-Jun-2025

• Security patching of Docker containers

• Authorization Server update and dependencies (infrastructure)

• Cloud Manager upgrades (infrastructure)

• Disallows downloading of shared symlinks

• Minor user interface fixes

• Apollo: London region deprecated

• Apollo: Security patching of the Snowflake Python connector. Added binning to the Boxplot functionality.

No Release for 27-May-2025

Release for 20-May-2025

• Security patching of Docker containers

• Added features for the TRE administrator to describe projects

• Minor UI changes from bugfixes

• Added the timestamp when archiving initiates

• Added the status of projects reported in the data catalog

• Removed AWS London (General) Thrift server

• Apps: updated FastQC to v4.1.0

• Apollo: no release

Release for 13-May-2025

• Security patching of Docker containers

• Fixes to erroneous 509 errors to the appropriate error code. Fixes of 404 errors on private endpoints.

• Migration to the newer user interface

• Apps Update: REGENIE 2.0.3 and PRSice 2 v1.0.6

• Apollo: update histogram API to include statistics output

Release for 06-May-2025

• Security patching of EC2 instances and Docker containers

• Refactoring drive shares to support backwards compatibility with earlier versions.

• Continued hardening of NVIDIA drivers

• Efficiency enhancements for the Trusted Research Environments (TRE)

• Apps Update: PRSice 2, LocusZoom 1.2.3, and REGENIE 2.0.3 released

• Apollo: upgrade JDK in Apache Spark and dxspark 3.5.2 packages,

• Apollo, upgrades including:

  • Structural Variant and Fusion support in Somatic Variant

  • Add Pearson correlation coefficient output to scatterplot API

  • Fix fusion post-processing in somatic-genomic-range API

  • Update field validation for locus-details API

  • Add support for partitioned expression datasets

  • Fix fusion affected samples in somatic-genomic-range API

  • Cohort filter optimization for expression assay data

  • Detailed information in output of boxplot API

  • Fix counts for lollipop-plot API

  • Add new feature-expression API

  • Use memory optimized VizserverDataset in vizserver

• Apollo fixes for fusion affected samples in somatic-genomic-range API and cohort filter optimization for expression assay data

Release for 29-Apr-2025

• Security patching of Docker containers

• Security patching of the NVIDIA drivers to address CVE-2025-23244 and related CVE-2025-23245 and CVE-2025-23246

• Efficiency enhancements on writable symlinks and drives

• Apollo: no release

Release for 15-Apr-2025

• Security patching of Docker containers

• Dependency updates. Fixes to writable symlinks and user interface fixes for table displays

• Apollo: infrastructure upgrades

Release for 08-Apr-2025

• Security patching for EC2 instances and Docker containers

• Efficiency enhancements to project storage limits to more frequent reporting

• Refactoring of open source libraries to address security vulnerabilities, patching of the secure browser used in TREs and fixes to the file describe functionality regarding symlinks

• Apollo: No Release.

Release for 01-Apr-2025

• Security patching for Docker containers

• Enhancements on watermarking in data dispensals

• Apollo: Structural Variant and Fusion support in Somatic Variant

• Add Pearson correlation coefficient output to scatterplot API

• Fix fusion post-processing in somatic-genomic-range API

• Update field validation for locus-details API

• Add support for partitioned expression datasets

Release for 25-Mar-2025

• Security patching for Docker containers

• Titan bugfixes and efficiency enhancements

• Apollo: No release. Downtime from 4-5pm UTC (9-10am PDT) for infrastructure upgrades

Release for 18-Mar-2025

• Security patching of Docker containers

• Titan: bugfixes

• Apollo: Upgrade of vizserver infrastructure

Release for 11-Mar-2025

• Security patching of Docker containers and EC2 instances

• Backend updates to enhance the UI, tuning of the infrastructure and clarification of error messages

• Apollo: minor tuning of the infrastructure

Release for 04-Mar-2025

• Security patching of Docker containers

• Titan: efficiency enhancements on project storage limit functionality and archiving functionality

• Titan: Bugfixes including SSO issues for isolated customers

• Apollo: Configuration and infrastructure component upgrades

Release for 25-Feb-2025

• Security patching of Docker.containers

• UI enhancements of the tool selector

• Apollo: no release

Release for 11-Feb-2025

• Fixes to bugs in writable symlinks and hardlink resolutions

• Apps: Subread featureCounts v0.2.0

• Apollo: no release

Release for 04-Feb-2025

• Infrastructure updates of node.js, AuroraDB

• Apps: gatk4_mutect2_variant_caller_and_filter v2.0.2, picard_downsample to v1.2.0 and picard_normalize_fasta to v1.2.0

• Apollo: updates to error messages when > 512 MB for dx extract_* commands

Release for 28-Jan-2025

• Security patching for Docker containers

• Adding information to the API logs — more detail in the API call

• Internal metering to drive efficiency enhancements

• Bug fixes to the User Interface

• Apps: Update GLnexus to v1.0.5, snpeff_annotate, Subread featureCounts v0.2.0

• Apollo: Internal upgrades to Spark 3.5.2

Release for 14-Jan-2025

• Security patching of EC2 and Docker containers

• Data catalog launch with conversational search (limited audience)

• Apps: bowtie2_fastq_read_mapper upgraded to v2.1.0 and app-freebayes upgraded to v3.0.0

• Apollo: SQL query updates to "all", "any", and "not-any" filters in the Cohort Browser

Release for 17-Dec-2024

• Security patching of Docker containers

• Efficiency and bugfixes for writable symlinks and object deletion process

• Apps: gatk4_haplotypecaller_parallel v2.2.2 and gatk4_halotypecaller_rnaseq v1.0.2 are released to production

Release for 10-Dec-2024

• Security patching for EC2 and Docker containers

• Titan Refactoring: fixes in the data catalog and DBCluster, and tuning of the symlink functionality

• Apps: FastQC v4.0.2 is released to production

Release for 03-Dec-2024

• Security patching

• Refactoring to extend the internal management of secrets, upgrades to the worker to support the latest pyPI functionality and internal upgrades from node.js v18 to v20.

• Apollo: addition of the locus_ids in the details field API

Release for 26-Nov-2024

• Security patching for Docker containers

• Updates to writable symlinks - added functionality

• User interface improvements regarding tables, spend limits

• Apollo: Fix for status reports on deeply nested directories in Azure

Release for 18-Nov-2024

• Security patching of Docker containers

• Added: BILLING_COMPUTE_COREHOURSURCHARGE_SKU and BILLING_COMPUTE_SPOT_INVOICING

• Update field dependencies, bugfix for the getDetailsDate objects descriptors. Updates to clone restrictions for writable symlinks

• Updates to the spending limits

• App Update: sra_fastq_importer to v5.0.1, bowtie2_fast1_read_mapper to v2.1.0

• Apollo: Minor fixes

Release for 05-Nov-2024

• Security patching of Docker containers and EC2 instances

• Update of concurrency to drive services

• Library updates to s3deleter, audit log processing, API servers and download functions

• Updates to the details in the user spend limits on the User Interface

• Apps: LocusZoom upgrade to v1.2.2, snpeff_annotate to v3.0.0, bowtie2_fasta_indexer updated to v2.1.0, hisat2_index to v2.0.1, hisat2_mapper to v2.0.1, jellyfuish_and_genomescape to v2.0.1, and strelka2_germline to v1.2.1

• Apollo: new databaseResultsRestricted changes

Release for 22-Oct-2024

• Security patching of Docker containers

• Updates to OIDC and writable symlinks

• User Interface updates and fixes for URL redirects in httpsApps

• App Releases: SVAL upgrade to 1.0.1

• Apollo: Additional support somatic variant datasets

Release for 8-Oct-2024

• Security patching of Docker containers and EC2 instances

• Efficiency enhancements via concurrent job event queues

• NVIDIA driver enhancements - additional drivers and ability to select the desired NVIDIA driver for their workers

• App Releases: prsice2 v1.0.4 and raremetal2 v1.0.2

• Apollo: Upgrade apps

Release for 01-Oct-2024

• Security patches for Docker containers

• GxP document cleanup

• Titan bugfixes for https-apps that truncated URLs and for https-apps that broke redirects

• Update NVIDIA drivers in the workers

• For appropriate subscribers upload and download functionality from writable symlinks

• App Releases: GATK BQSR (Parallel) v3.2.0, RSEM v0.3.3, FastQC v4.0, SVAL 1.0.0,

• Apollo:

  • Security fix forbidding the use of '{' and '}' in restricted commands

  • Fix building of cohort query for pheno-somatic dataset linked by non-global primary key.

Release for 24-Sep-2024

• No release for Titan or Apollo

• Release of REGENIE apps (version 2.0.1)

• Release of MultiQC app (v 2.3.0)

Release for 17-Sep-2024

• Security patches for Docker containers

• Hardening of secrets management

• Bugfixes on usage limits

• User Interface upgrade to the React 18 framework

• app-pling_gwas was upgraded to version 1.1.0

• Apollo: upgrade of internal Python to version 3.11 and accompanying libraries

Release for 10-Sep-2024

• Security patches for Docker containers and EC2 instances

• Efficiency enhancements and fixes of the User Interface

• The dxCompiler Docker image published to Docker Hub is deprecated and will be removed after November 1, 2024. As a replacement, there are instructions to build the image

• App app-plink_gwas upgraded to 1.1.0 including an upgrade to the supporting dxfuse functionality

• Apollo: Security patching, fixes in the allele frequency for somatic variant assay in the genomic-range API.

Release for 27-Aug-2024

• Fixes for data dependencies and User Interface bugs

• Updated the Somatic Variant Assay Loader

• Updated the app-snepeff_annotation application

• Apollo: Fix of search in the system/findDatabases API

Release for 20-Aug-2024

• Security patching for Docker containers

• Bugfixes for Titan, including fixes to remove duplicate tokens and reporting project spending limits

• Release of Picard CollectMultipleMetric v2.1.2, STAR Fusion Caller (v1.0.1), MQC update of internal binaries and a fix customer content bug

• Apollo: Fixes for Oncoplot and fix for the search in database functionality

Release for 13-Aug-2024

• Security patching for Docker containers and EC2 instances

• Bugfixes in Titan

• Apollo: adding lollipop-plot for somatic variant analysis

• Release of GATK4 BQSR (parallel) v3.1.0 to the tool library

Release for 06-Aug-2024

• Security patching for Docker containers

• New internal functionality to support writable symlinks

• Removing some error message emails

• Re-enabling remaining usage estimates on the org billing page. This includes storage estimates and other usage metrics.

• Apollo: Fixes to the somatic variant functionality, including the addition of new datasets

Release for 30-Jul-2024

• Security patching for Docker containers

• Bug fixes for project rollup pages, writable symlinks UI and other minor UI fixes

• New functionality to allow finding external drives (for selective customers)

• Apollo: VizServer updates, HDFS filesystem updates across all regions containing Apollo

Release for 23-Jul-2024

• Security patching for Docker containers

• node.js upgrade to the server and supporting libraries

• Writable symlinks are supported (behind a feature switch)

• Bug fixes to address Redis issues, OIDC fixes, and fixes to the monthly estimate calculations

• Apollo: memory expansion of backend vizserver and Thrift servers

Release for 16-Jul-2024

• Security patching for Docker containers

• Fixes to auto-provisioning users and cloud manager

Release for 09-Jul-2024

• Security patching for Docker containers and EC2 instances

• Fixes to DBCluster describe

• Efficiency improvements on index caching and token-based authentications

• CVE-2024-27322 patched on R-based apps. Unpatched version is still present for existing pipelines.

• Apollo: fixes to API counts in vizserver, additional ability to query somatic datasets

Release for 25-Jun-2024

• Security patching for Docker containers

• Fixes for email notifications when approaching the spending limits

• Efficiency enhancements for archiving

• Somatic variation applicable is now available (first phase)

• Spot instances are available in Azure

• Apollo: efficiency enhancements in API calls

Release for 18-Jun-2024

• Security patches for Docker containers and NVIDIA drivers

• UI changes to make the columns easier to read

• Adding additional billing functionality

• Apollo: additional code to check database access before making queries

Release for 11-Jun-2024

• Security patches for Docker containers and EC2 instances

• Fixes on project storage limits

• Version upgrades for dxpy for Nextflow

• Apollo: performance fixes

Release for 04-Jun-2024

• Security patches for Docker containers

• Bug fixes and efficiency enhancements on archival services, enhancements to the metadata storage database and DBCluster accounting

• Version upgrades to dxpy for new Nextflow pipelines

• Azure spot instance enhancements

• Apollo: query builder fixes

Release for 21-May-2024

• Security patches for EC2 instances and Docker containers

• Updates to MySQL object to the latest version

• Fixes to airlock functionality of the TRE, Azure spot functionality, and minor UI fixes

• Apollo: Enhanced filter support for somatic variant data in the Cohort Browser

Release for 14-May-2024

• Security patches for Docker containers and EC2 instances

• Added multiple functions to support write-able symlinks

• Deprecated some SSO functionality that is no longer used

• Refresh of CIS Level 2 hardening of Ubuntu instances

• Fixes to the spending and storage limit functionality

• Apollo: Fixes to project describe symlinks

Release for 07-May-2024

• Security patches for Docker containers

• Bugfixes in Titan for DBCluster billing, project storage spend limit, JobID token

• Apollo: Fixes to the file describe functionality

Release for 30-Apr-2024

• Security patches for Docker containers

• Fixes for Titan egress events, UI. Added additional information in the error messages.

• Apollo: Minor fixes in the error messaging

Release for 23-Apr-2024

• Security patching for Docker containers

• TRE: Fixes for withdrawals of data, withdrawal of data with watermarks and withdrawal enforcer

• Performance improvements on lateral scaling of concurrency and spending limit enhancements

• Apollo: Fixes with symlinks in Azure

Release for 16-Apr-2024

• Patches for Python and Java, patching of Docker containers

• User Interface modifications about withdrawal functionality and execution lists

• Apollo: bug fixes around symlinks in Azure

Release for 09-Apr-2024

• Patching of EC2 instances and Docker containers

• Updates to the pricing model for DBCluster charges

• Changes to the User Interface for monitor page

• Cloud usage reporting, with project spend limits and notifications

• Apollo: bugfixes

Release for 26-Mar-2024

• Security patching for Docker containers

• First component of writable symlinks

• Apollo: bugfixes file describe functionality and cleanup of abandoned symlinks

Release for 12-Mar-2024

• Security patching for Docker containers and EC2 instances

• UI fixes for the project change list

• Apollo: fixes to the filecloser

Release for 05-Mar-2024

• Security patching of Docker containers

• Refactoring of API proxy and tokens

• Added security.txt file

• Apollo: updates to symlinks functionality.

Release for 27-Feb-2024

• Security patching of Docker containers

• Efficiency enhancements on the API proxy upload functions

• Fixes to the search terms to accept odd characters

• Apollo: symlink changes

Release on 13-Feb-2024

• Security patching of Docker containers and EC2 instances

• Fixes to DBCluster pricing and project spend limits

• Updated dxpy version in workers

• Apollo: No release

Release on 06-Feb-2024

• Security patching of Docker containers

• UI fixes when deleting more than 10,000 files in a folder and the obscured "New Folder" in some menus

• Fixes to user-initiated withdrawals, fixes to watermarking, fixes to the email notification of spend limits, fixes to DBCluster billing, and fixes to project archiving when the project contains many files.

• Apollo: Fixes in the Azure directories for Azure instances.

Release for 23-Jan-2024

• Security patching of Docker containers and EC2 instances

• Fixes billing for DBClusters

• Efficient implementation of watermarking

Release for 9-Jan-2024

• Security patching of Docker containers

• Spending limit changes

• Job log forwarding (licensed customers only)

• Apollo: Vizserver security patching

Release for 19-Dec-2023

• Vulnerability patching of Docker containers and EC2 instances

• Bugfixes to API proxy, container cleanup, and project spending limit.

• Implement the foundation code for user-initiated withdrawals.

• Changes to increase efficiency of the watermarking processes

• Apollo: Security patching of SDKs

Release for 12-Dec-2023

• Vulnerability patching for Docker containers

• Fixes to the details execution page and file viewers on the UI, fixes to the global workflow, fixes in the API proxy

• Apollo: bugfixes calculation of the cohort allele frequency in the Cohort Browser for genomic data without linking to primary phenotype entity

Release for 05-Dec-2023

• Vulnerability patching for Docker containers

• Fixes to the user interfaces to allow file view to work in all browsers (due to security changes within certain browsers)

• Fixes and additional parallelization of data dispensal streams

• Fixes to the details execution page in the user interface

• Apollo: fixes to the data-clearcache on the vizserver API

Release for 28-Nov-2023

• Security patching for Docker containers

• "Look and feel" user interface changes on the execution details view

• Titan: fixes to the 30-day worker limitation and fixes to the project spending limits

Release for 14-Nov-2023

• Security patching for Docker containers, EC2 instances, and patching minor versions of dependent libraries

• Command-line access to expression assay model for RNA-seq and molecular expression data

• Apollo: Updating the rounding algorithm in the Spark databases for increased scientific accuracy. This may impact the bins for the histogram of the Cohort Browser

Release for 07-Nov-2023

• Security patching for Docker containers

• Titan: fixes in data dispensals, project spend limit enforcement, and UI fixes in the workflow diagrams

• Apollo: Fixes error messages arising from the Vizserver API

Release for 31-Oct-2023

• Security patching of Docker containers

• Titan fixes to provider describe functions, fixes to the scalability of the dispensal microserver, fixes to the execution details display, fixes to the watermarking function, and fixes to the metadata capacity lambda

• Apollo Application: Somatic Variant UI – initial release of the user interface for the Somatic Variant query/visualization app

• Apollo: scalability changes to enhance the responses for queries

Release for 24-Oct-2023

• Vulnerability patching of Docker containers

• Deprecation of the DNA_CLI_APP_RUN_DOCKER_CONTAINERS functionality

• Watermark enhancements, UI cleanup, efficiency improvements, and correction of the spinning DNAnexus logo

• Apollo: Enable search of a minimum of 2 characters (instead of 3) in the Cohort Browser

Release for 17-Oct-2023

• Vulnerability patching of Docker instances and EC2 systems

• Fine tuning of spend limit controls, fixes to project list folder displays

• Apollo: expanding the scope of watermarking, security patches, library upgrades

Release for 03-Oct-2023

• Security patching of Docker containers for new vulnerabilities

• Updating the security ciphers for nginx services

• Bugfixes for project spend reporting, project relationship reporting, job reporting and project rename folder issues

• Apollo: Security upgrade of underlying open source libraries. Bugfixes for microservice code and regex for special character scanning.

Release for 25-Sep-2023

• Security patching of EC2 instances and Docker containers for new vulnerabilities

• Fixes of project spend limit reporting, access to restricted jobs, and fixes to storage accounting

• Apollo: removal of deprecated security ciphers

Release for 12-Sep-2023

• Security patching of Docker containers for new vulnerabilities

• Fixes to the deletion queue services

• Apollo: Vizserver fixes

Release for 29-Aug-2023

• Vulnerability patching for Docker containers and lambdas

• Expansion of the security ciphers for data in transit to include 1.2 and 1.3

• Titan: Fixes to project spending limit reporting, DBClusters

• Apollo: upgrade to SQLAlchemy 1.4 and optimizations on the query builder for somatic variant analysis.

Release for 22-Aug-2023

• Vulnerability patching for Docker containers and lambdas

• Support for canonical transcript annotation

• Efficiency optimization for the object deletion process, replacing open source code that is reaching end of life

• Apollo: internal changes to support new internal digital signatures (Supply Chain related)

Release for 15-Aug-2023

• Vulnerability patching for Docker containers

• Disallowed executables will not disable any workflows containing these disallowed executables

• Fixes in the UI for Tool Runner

• Apollo: Performance enhancements for the Vizserver

Release for 08-Aug-2023

• Vulnerability patching for Docker containers for new vulnerabilities

• Fixes to long running jobs logs, refactoring logic for email arising from job notifications and minor UI fixes

Release for 01-Aug-2023

• Vulnerability patching for Docker containers for new vulnerabilities

• Fixes for orphan projects, access to long running jobs, and minor UI fixes

• Apollo: security patching of libraries

Release for 25-Jul-2023

• Vulnerability patches for Docker containers for new vulnerabilities

• Fixes to airlock, granular long job notifications, access to long running jobs, fixes to spending limit controls and fixes for the file closer lambda

• Fixes to the Tool Runner UI for WDL workflows

Release for 18-Jul-2023

• Patching known vulnerabilities in Docker containers, EC2 instances, workers, and other system components

• Fixes to the authentication token deletion and enforcement of egress limits

• Support for canonical transcripts, genomic data loading for somatic variants, CLI access for the somatic assay model. Project Level Usage Reports (limited release)

• Apollo fixes for: updated generates SQL queries and other fixes.

Release for 11-Jul-2023

• Patching known vulnerabilities in Docker containers

• Batch runner and Tool Runner update on the web interface, resulting in a significant change in the UI and behavior

• Updated worker toolkits

• Project spend limitation reporting (licensed feature)

• Bugfixes in org-admin notifications, Azure cloud manager and other bugfixes

Release for 27-Jun-2023

• Patching known vulnerabilities in Docker containers for new vulnerabilities

• Fixes to egress and compute charge reporting

• Fixes to job restart functionality and long running job notifications

• Apollo: fixes to enforce the 5 minute query timeouts

Release for 20-Jun-2023

• Airlock functionality added for Trusted Research Environments (TREs)

• Bug fixes to job restarts, project spend processes and fixes to the back button of the Community Portal

• Increase the size of the job log from 2M to 4M

• Security patches to Docker containers for new vulnerabilities

• Apollo: minor bug fixes in the somatic variant functionality and error reporting

Release for 13-Jun-2023

• Security patching of vulnerabilities on Docker containers and EC2 instances

• Detailed job metrics (limited release through the balance of the year)

• Apollo: bugfixes and infrastructure upgrades. Support for multi-assay support for Genetic Variant assays

Release for 06-Jun-2023

• Security patching for Docker containers

• Better error messaging for users authenticating via SSO

• Project admins will be notified via email when their project has crossed thresholds of metadata capacity

• Preserve intermediate job outputs to aid in error tracking

• Fixes to job restart issues, better error messages

Release for 23-May-2023

• Security patching for Docker containers

• Fix for Community UI - after 15 minute timeout, the user is correctly redirected to the Community login page

• Apollo: Deprecate the apps association loader feature, extend the timeout for complex data fetches to 5 minutes

Release for 16-May-2023

• Deprecate DNA_API_ORG-REPORT_HISTORICAL_CHARGES function

• Security patching for Docker containers, lambdas and EC2 instances

• Fixes to cloud manager and UI redirect issues

• Apollo: support for large scale database operations (important for handling WGS data)

Release for 09-May-2023

• Security patching Docker containers

• Titan: fixes to known issues

• Apollo: fixes to issues, such as internal ID, return timeout errors from long running data fetches to vizserver

Release for 25-Apr-2023

• Security patching of Docker containers

• Continuing the migration of the DNS to AWS' Route53, refactoring known issues

• Apollo: fixes to the query builder

Release for 18-Apr-2023

• Security patching of Docker containers and applications

• Changes in the EBS swap volume with gp2 and SSD instances to fix known issues

• Apollo: fixes to the vizserver to allow more database access

Release for 04-Apr-2023

• Security patching of Docker containers

• Ubuntu 22.04 AMIs available on both AWS and Azure execution planes

• Apollo: upgrades to the Spark server and related package updates

Release for 28-Mar-2023

• Deprecating JavaScript monitoring

• Security patching of Docker containers

• Changes to the User Interface to become CWAG 2.0 AA compliant

• Apollo: refactoring known issues, including large query handling by default

Release for 21-Mar-2023

• Refactoring of the asynchronous archive services

• Refactoring of the job re-use and support workflow. This includes support for WDL workflows.

• Apollo: Refactoring of the geno filters for the command line interface

Release for 14-Mar-2023

• Security patching for Docker and VMs

• Refactoring of job restart, asynchronous archival and UI backend changes

• Apollo: Spark server upgrades, Python upgrades

Release for 07-Mar-2023

• Security patching on Docker containers and lambdas

• Fixes for job preservation functionality

Release for 28-Feb-2023

• Security patching for Docker container, lambdas and Ubuntu instances

• Fixes to the Titan file uploader and cosmetic changes to the UI in the input components

• Apollo: deprecation of the Association Browser

No Release for 21-Feb-2023

Release for 14-Feb-2023

• Monthly security patching for Ubuntu instances, patching of vulnerabilities for Docker containers and AWS lambdas

• Migration of platform service instances from Ubuntu 18.04 to 22.04 or 20.04 when impossible to fully migrate

• UI fix to SSO users who are confronted with separate MFA prompt

• Apollo: fix issues in dxfuse

Release for 07-Feb-2023

• Granular wait time for spot instances for workflows (subscriber licensees only)

• Docker container security patching

• Refactoring of job refuse to support workflows. This includes WDL workflow support.

• Refactoring of known issues in Titan including s3deleter, spot granularity issues, expansion of the metadata capacity in the describe API call, UI fixes to SSO users

• Refactor of known issues in the initial login of the thrift cluster, more granularity in log reporting

Release for 31-Jan-2023

• Patching of Docker container vulnerabilities

• Titan: Fixes to the UI and s3deleter functionality

• Apollo: fixes to enforcing region boundaries and API proxy issues

Release for 24-Jan-2023

• Workflow Job Reuse will be deprecated, replaced with functionality elsewhere

• Change GiB to GB e in the job disk comparison

• Added new functionality to Titan, specifically:

  • DNA_API_PROVIDER_PERMISSION_RESTRICTIONS - Project/org restrictions should be enforced based on the provider constraint options choice

  • DNA_API_PROVIDER_DATA_CLONING_RESTRICTIONS - User is not able to clone data from restricted to unrestricted project or from restricted to restricted project with different studyID

  • DNA_API_PROVIDER_JOB_RESTRICTIONS - Restriction on building tools into the project from the user's computer or analyses

• FastQC app (v2.2.3 and earlier) is deprecated

• Nextflow - GA to a limited set of users

• Added new functionality to Apollo, specifically:

  • TIP_DATA_ACCESS_PROJECT_RESTRICTIONS - The system can limit users access to data based on project settings and license

  • TIP_DATA_DISPENSAL - User can create project containing data specified by studyID

Release for 10-Jan-2023

• New Titan Functionality

  • DNA_API_INTERNET_JOB_RESTRICTIONS - Data providers can restrict the internet access for jobs running in Trusted Research Environment (TRE) projects to prevent egress of sensitive data from the TRE

  • DNA_API_EXTERNAL_UPLOAD_RESTRICTIONS - Project admin can restrict users ability to upload data into trusted research environment (TRE) projects outside of the jobs running in the TRE

  • DNA_GUI_EXTERNAL_UPLOAD_ACCESS_RESTRICTED - User cannot upload files into the External Upload restricted project

  • DNA_GUI_EXTERNAL_UPLOAD_ALLOWED_FILE_UPLOAD - User can upload files into the External Upload allowed project

  • DNA_GUI_EXTERNAL_UPLOAD_PROJECT_SETTING - User can change External Upload Access setting

  • DNA_GUI_JUPYTERLAB_EXTERNAL_UPLOAD_RESTRICTED - External upload options are not available in JupyterLab job running over the External Upload restricted project

  • DNA_API_OFH_PROJECT_CREATE - User can create new project with data dispense or without data dispense option

  • DNA_GUI_OFH_PROJECT_CREATE - User can create new project with data dispense or without data dispense option

  • DNA_GUI_OFH_CREATE_ACCOUNT - User can create new account via OFH Landing page

  • DNA_GUI_OFH_USER_ASSOCIATION - User can make association of DNAnexus and AMS account

  • DNA_GUI_OFH_USER_2FA - User is prompted to set 2FA and it is impossible to remove it

  • DNA_GUI_OFH_USER_BILLING_INFO - User has XX GBP billing trial balance and default region is Azure OFH-TRE (London) after successful association

• G5 GPU workers available in specific cloud

• Apollo bug fixes: Fix for license and region checks

• New Apollo Functionality

  • TIP_JOB_INTERNET_RESTRICTION - The system can restrict internet access in worker jobs

  • TIP_EXTERNAL_UPLOAD_RESTRICTIONS - Upload restricted projects have limited access

• Titan bug fixes: Updates for the API server and Azure Cloud Manager. Fix of granularity for spot instances, fix of race condition for hard links updates. Archival state fixes

• Docker Container vulnerability patching

Release for 13-Dec-2022

• DNAnexus is on AWS' Marketplace, so if you have AWS-issued credits, you can consume them via this mechanism!

• Vulnerability patching of worker AMIs and Docker containers

• Fixes to the external uploader restrictions, code cleanup

• Apollo: Fixes to the Visualisation Server and API server. Cleanup of error messages

Release for 06-Dec-2022

• Vulnerability remediation of Docker vulnerabilities

• Completion of the annual SSL cert rotation

• Apollo: fixes to the metastore, fixes to the clipboard functionality in the visualization module and other bugfixes

Release for 29-Nov-2022

• Complete migration to new SSL certificates throughout the infrastructure

• Bugfixes for billing, upload restrictions and SSO logins will no longer be redirected to the Project Page

• Apollo: fixes to encryption of upload URLs in the API proxy and other minor fixes

Release for 15-Nov-2022

• Security patching of the Titan User interface

• Upgrading upload restrictions at the project level

• Patching Docker containers to address new vulnerabilities

• Apollo: updating SSL certs and refactoring app interactions

Release for 08-Nov-2022

• Docker security patching and hardening

• User Interface security patching

• Apollo: bugfixes, library updates, security patching

Release for 01-Nov-2022

• Update OpenSSL v3 to 3.0.7 patch level

• Patching Docker containers and CIS level 1 hardening

• Fixes of known Titan issues

• Apollo: bugfixes to known issues.

Release for 25-Oct-2022

• Code optimization, bugfixes in the User Interface

• Vulnerability patching for Docker containers

• Apollo: fix API proxy issues, regex fixes for routes and other fixes.

Release for 18-Oct-2022

• Security patching of operating system and Docker containers

• Additional Nextflow functionality added to Titan and Apollo

Release for 04-Oct-2022

• Bugfixes to Titan and Apollo

• Docker vulnerability patching

Release for 27-Sep-2022

• Fix for 2FA prompt for existing SSO accounts

• Fix for Jupyter Notebook calls

• Fix to block archiving of object linked to applets

• Vulnerability patching of Docker containers

• Apollo: upgrades to the internal cache and related internal upgrades

Release for 20-Sep-2022

Cohort Browser

• Filecloser, asynchronous archival function, and API proxy bug fixes

• Internal upgrades of the metadata database

• Apollo: fixes to the Cohort Browser and fixes to internal API routes

Release for 13-Sep-2022

• End-to-end FIPS 140-2 validated ciphers within the FedRAMP boundary

• Bugfixes to the authentication server

• Apollo: bugfixes to known issues

Release for 23-Aug-2022

• Hardening of routes behind the User Interface

• Vulnerability patches to the Docker containers

• Apollo: Additional granularity to the logging and billing. Cleanup of error messages.

Release for 16-Aug-2022

Cohort Browser

• Added Monitoring and Restriction Controls regarding download and egress, ability to preview, IP addresses of users, and additional security features

• Bug fixes on streams containing gzipped files

• Apollo: Fixes to the 30K Cohort Browser encoding

Release for 09-Aug-2022

• Complete migration to OpenSSL v3

• New functionality to restrict IP domains for certain API calls

• Updates to the NVIDIA drivers for GPU users

• Increase the partition sizes for LXC

• Security patching of Docker Containers

• Apollo: Restrictions to downloads from Apollo

Release for 02-Aug-2022

• Security patching for Docker Container vulnerabilities

• Usage report fixes

• Hardening of routes in the User Interface

• Increases in timeout period for dxproxy

• Apollo: enhanced CLI based querying, fixes to HDFS filesystem

Release for 26-Jul-2022

• Upgrade the metadata database to Mongo 4.4

• Upgrade node.js to v14

• fixes to Archiving in AWS regions

• Apollo: no release

Release for 19-Jul-2022

• LXC filesystem limit increased

• Monthly security patching

• Upgrade for SSO users who switch accounts

• Apollo: CLI based data querying

Release for 12-Jul-2022

• Security patching of Docker containers

• User Interface self-service billing functionality

• Improved clinical data ingestion experience

• Apollo: Refactoring of VizServer

Release for 28-Jun-2022

• Fix of the "create" functionality of DBCluster (AWS deprecated previous engine on 25-Jun-2022)

• Refactoring of user interface issues

• Patching security vulnerabilities of EC2 and Docker containers

• Refactoring issues of the cloud manager on Azure

• Apollo: Enhance validations and experience around ingesting clinical data

Release for 14-Jun-2022

• Internal refactoring of reported issues

• End-to-End FIPS 140-2 validated encryption throughout Titan

• Vulnerability patching of Docker containers

• Apollo: refactoring user interface issues

Release for 07-Jun-2022

• Vulnerability patching for images and Docker Containers

• Titan new functionality: DNA_API_ORG_REPORT_HISTORICAL_CHARGES

• Apollo new functionality:

  • TIP_VIZ_COHORT_COMBINE

  • TIP_APPS_COHORT_COMBINE_REBASE

  • DNA_GUI_COHORT_COMBINE

• Apollo: fixes on Azure deployment. Upgrades to the Spark engine.

Release for 23-May-2022

• Updates to the internal CloudManager and fixes to microservices

• Vulnerability patching of images and Docker containers

• UI fixes

Release for 17-May-2022

• Refactoring of multiple analyses workflows, more info on the spending limits and updates to the cookie notice

• Security patching of the underlying operating systems and worker AMIs

• Apollo: no release

Release for 10-May-2022

• FIPS 140-2 encryption implemented for uploading/downloading from the storage plane

• Apollo: no release

Release for 03-May-2022

• Minor fixes and normal vulnerability patching of the User Interfaces and supporting libraries

• Apollo: minor fixes, including the ability to query without a primary key

Release for 26-Apr-2022

• Security updates for the infrastructure

• Backend fixes to support upgrading the metadata database software version upgrades

• Apollo: Enhancements of existing functionalities to ease the creation of mixing multiple cohorts

Release for 12-Apr-2022

• Restrictions for SSH functionality

• Refactoring of known issues related to container cleanup, caching, and resource management

• Apollo: Ability to export up to 200 columns in a table. UI fixes

Release for 05-Apr-2022

• Tuning to optimize workflow runs

• Updates to the documentation pages of the applications

• UI fixes to show app versions in descending order, other minor UI fixes

• Apollo: refactoring of known issues in the user interface

Release for 29-Mar-2022

Cohort Browser

• Order pending jobs by rank

• Node.js updates

• Tuning of the thrift server throughput. Help the combination of cohorts in the Cohort Browser.

Release for 22-Mar-2022

• Fixes to known issues, such as a fix to the scope of unarchiving to better control the scope, updated the internationalization library (fixes for text fields in the UI).

• Apollo: Refactoring of issues with field mapping and support for ordered fields.

Release for 15-Mar-2022

• Refactoring the User Interface to address issues, including moving the workflow input to the Project workflow pages.

• Fixes to the unarchiving functionality, tighter control of scope of the unarchiving

• Apollo: Refactoring of issues arising from the visualization APIs

Release for 08-Mar-2022

• Refactoring known issues in the DBCluster, internal changes to FIPS 140-2 validated ciphers, Cloud Manager, fixes to the app updater when archive resources are involved, and other core systems

• Updates to community portals - caching is now disabled

• Apollo: Refactoring of the issue involving model input.

Release for 01-Mar-2022

• Vulnerability patching of operating systems

• Fixes to code compatibility to rush.js

• Support ticket generation will be tagged with the Platform page of origin

• Apollo: Enhanced support for bulk RNAseq data in a dataset

• Apollo: Security and version number upgrades of servers

• Apollo: Removal of auto-loading a chart, so the user will be prompted to generate the chart

Release for 15-Feb-2022

• Implemented FIPS 140-2 validated endpoints for archival functions

• Bugfixes, such as issues reported in unarchiving function and email org_invite function

• Updating reCAPTCHA functionality

• Apollo: Added functionality to allow a user to include Molecular Expression data into a dataset

• Apollo: Fixes to issues in Thrift and VizServer.

Release for 08-Feb-2022

• Update to Node.js v12 for the infrastructure

• Backend updates to rush.js version in some lambdas, revising metadata sharding approach, updates to s3_deleter and minor bugfixes to the User Interface

• Apollo: Address known bugs, including limiting the number of tiles in the dashboard to a maximum of 15

Release for 01-Feb-2022

• Bug fixes on job restarts, rush.js updates and increased granularity of data in the Audit Trail

• Apollo: Besides bugfixes, the following functionality was added: TIP_APPS_CLINICAL_DATASET_MERGER - Users will be able to merge phenotypic datasets and TIP_APPS_ASSAY_DATASET_MERGER - Users will be able to merge an assay dataset and a phenotypic dataset

Release for 25-Jan-2022

• Update of security patches of identified vulnerabilities

• Spend limit enforcements

• Enhancements for job filters

• Updates to the email filters

• Apollo: fixes to address solution-exception messages, fixes of the update API calls, and removal of blank pages in the User Interface

Release for 11-Jan-2022

• Service Provider Single Sign On (SSO)

• User Interface fixes

• CloudManager enhancements (internal)

• Apollo: updates and fixes of reported issues

Release for 14-Dec-2021

• Fixes to Cloud Manager, visibility into the org license for the org-admins

• Removed all Ubuntu 16.04 instances from production. Ubuntu 16.04 is available at the app level

• UI fixes to the monitor pages. Improve state transition regarding Jupyter Notebooks

• Apollo: refactoring known issues, such as name tags and interface elements

Release for 07-Dec-2021

• User Interface fixes to cancel transfers

• Fixes for the initiation of nested workers and the API call for apprun worker limits

• Monthly Security patches

• Apollo: fixes for zero length files, security patches to packages and libraries

Release 30-Nov-2021

• Button changes on the Web User Interface

• Throttling re-enabled, refactoring of known issues

Release for 16-Nov-2021

• Complete migration of the UI to React 17 with UI changes to the Data manager, removal of the Global Search button

• Refactoring of known issues, including fixes to watermarks and visual elements

Release for 9-Nov-2021

• Additional metrics for spin up and interval time for instances

• User Interface infrastructure updates to React 17

• Infrastructure consolidation for load balancing

• Security patching

• Apollo: refactoring of known issues

Release for 26-Oct-2021

• Org Admin can view each org member's userID and email address

• Refactoring minor bugs, including fixing timeouts and fixes to allow additional flexibility for UKB dispensals

• Apollo: Refactoring known issues

Release for 19-Oct-2021

• UI fix to https workers

• Refactoring of many reported UI issues

• Refactoring of unarchive issues

• Org Manager can access the org user's email addresses

• Refactoring of the UKB rate card

• Self-service billing for UKB RAP and PayGo customers only

• Apollo: no release

Release for 05-Oct-2021

• Monthly Security Patching

• Deprecation of Global Search

• Apollo: no release

Release for 28-Sep-2021

• Refactoring of CloudManager

• Additional heartbeat monitoring of the infrastructure

• Refactoring of user interface issues

• Apollo: Refactoring of known issues and updating the version of tRNA to feed Apollo

Release for 21-Sep-2021

• Changes to timeout on instance re-use

• Updates to the billing daemons

• Updates on data withdraw and refresh process

• Moving infrastructure components to node.js v12

• Apollo: Update of Spark to support v3.1.2 and fixes to database pointers

• Apollo available in AWS-Frankfurt

Release for 14-Sep-2021

• Additional logging for cluster jobs

• Added additional time for reserve instances

• Efficiency enhancements for listing projects

• User Interface fixes to reported bugs

• Chef upgrade on the infrastructure

• Apollo: Deprecation of the legacy Cohort Browser, efficiency enhancements of Spark and other fixes.

Release for 31-Aug-2021

• Updates to Job Manager and Cloud Manager

• Refactoring of issues on the User Interface

• Apollo: refactoring of filter parameters, UI and Spark 3.x upgrades

Release for 24-Aug-2021

• Audit logging updates

• Refactoring of the User Interface issues

• SendGrid changes for event-based email notifications

• Apollo: refactoring reported issues

Release for 17-Aug-2021

• London region archiving

• Refactoring of email alerts

• Code efficiencies around Audit Trail generation

• Efficiencies added to the backend code to allow more efficient list of projects.

• Apollo: refactoring known issues, efficiency enhancements and deprecation of the legacy Cohort Browser

Release for 10-Aug-2021

• Cloud Manager caching implemented in regions that use autoscaling

• Refactoring of internal database to increase efficiency

• Opening AWS region in London, will be visible on the user interface and rate cards in UK currency

• Internal Splunk updated to v8.1.5

• OpenJDK v11 updated on Ubuntu 18.04 AMIs

• Apollo: No Release

Release for 03-Aug-2021

• Switch to the Pannexin User Interface only

• Data master fixes in the User Interface

• Query optimizations

• Internal migration of the org-specific audit logs to a more efficient process

• Apollo: Refactoring of error messages, UI fixes to gene filter parsing an semaphore fixes for API calls

Release for 27-Jul-2021

• Reset job fix

• jQuery update

• Master Data UI fixes

• lambda functions update

• increase Cloud Manager Resilience

• Apollo: Refactoring known issues, including updates for code efficiencies and documentation

Release for 20-Jul-2021

• Restart job fix

• Internal update of jQuery to v3.6.0

• Monthly vulnerability patching implemented in production

• Apollo: Refactoring of known issues, including some minor refactor of UI for efficiencies

Release for 13-Jul-2021

• Additions to ProjectDescribe API to include ranking field

• Visualization tab of the User Interface will be migrated to the newer version (Pannexin)

• Job Manager efficiencies

• Apollo: Added TIP_VIZ_COHORT_ANDOR, DNA_GUI_COHORT_ANDOR_JOIN_FILTER, and DNA_GUI_COHORT_ANDOR_FILTER_GROUP functionality

Release for 29-Jun-2021

• Archive API updates

• Platform refactoring: Fixes to the User Interface and error handling when project files do not exist

• Ubuntu 12.04 and 14.04 instances will be deprecated. Workers using Ubuntu from 16.04 to 20.04 will continue to be supported.

• Apollo: Refactoring of R functionality and fixes to license checks

Release for 22-Jun-2021

• Updates to the billing page

• Fix to the GetDetails call, handling of incorrect API calls and code efficiencies

• Updating API servers to Ubuntu 18.04, security patching of infrastructure

• Fixes to getFileStatusURL, verify all filter values in an array, fixes in the data picker, fixes in the histogram functionality

Release for 15-Jun-2021

• Upgrade of the dependencies of the Auth Server

• Titan bugfixes

• Org Page UI changes

• Apollo: UI fixes

Release for 08-Jun-2021

• Refactoring for handling regions, fixes on cost limits, fixed prioritization and long-term fix for watermarking

• Egress Reporting

• Apollo: refactoring issues

• Apollo: TABBY release - moving sections to multiple tabs

Release for 25-May-2021

• Fixes on Rush.js project dependencies

• Correction of defects in the JobManager and JobEvents

• DBCluster updates to the latest TypeScript

• React.js library upgrade, which may have slightly changes to the visual appearance as well as possibly behavior changes

• Corrections to UserDescribe functionality

• Fixes FileStatus calls, changes for efficiency of filesystem calls, tuning cache sizes

Release for 18-May-2021

• Minor AMI changes for logging

• Revert of egress accounting change and some watermark functionality

• Additional information from file describe on watermarked files

• Functionality to allow org-admins to share projects across orgs

• dxCompiler support for bash variables

• Ubuntu 14.04 deprecated

• Apollo: Fixing the total count number when multiple alleles are involved, performance enhancement on the underlying database access methods

Release for 11-May-2021

• Job re-use with watermarking

• Cloud Manager updates

• Increase granularity in egress billing

• Apollo: fixes of known issues, such as retry logic on read conditions and efficiency changes in the User Interface

Release for 04-May-2021

• Updates to the DBCluster monitoring process

• Re-deployment of dl-proxy modules to support ungraded infrastructure

• Application context ID now included in the profiled projects, workers handle watermarked APIs, and additional platform optimizations

• Implementing monthly vulnerability patching

• Apollo: Fixes of known issues within Apollo, including data filter conditions and fixes to the Locus filter

Release for 27-Apr-2021

• Refactoring of watermarking code to address issues

• Refactoring of code performing bulk calls to reduce the volume of information returned

• Updated the user experience (UI) with a new root component error page. Formerly, an error would show a blank screen when the worker crashed.

• Implement Apollo on Azure West-US

Release for 20-Apr-2021

• DBCluster services were updated to be more efficient.

• Okta updates on dependencies

• Fixes to the autoscaling of the Cloudmanager infrastructure

• Fixes to the timestamps on expired/destroyed containers to integrate correctly in the metadata database

• Expanded IP range on workers

• PHI flag implemented on Azure

• Implemented the 2FA authentication in the Pannexin code (formerly only on the membrane UI code)

• Apollo: Updates to the metadata connect functionality

• Apollo: Fixes with the concurrency issues with API calls

• Apollo: Efficiency updates to reduce the number of API calls

Release for 13-Apr-2021

• Fix to allow UKB RAP users to download from multiple resources

• Continued rollout of v6 to v12 upgrades to Node.js in the APIproxy and CloudManager infrastructure

• Updates to allow the cloud manager to handle tagged AMIs

• Efficiency changes to the APIserver from the Monitor tab.

• UI fixes to the Cohort Browser where screen disappears and table crashes

• All AMIs on AWS will be Ubuntu 18.04. AMI updates on Azure will come later. Older AMIs will continue to be supported

• Apollo: Updates to the Vizserver to more efficiently use the API server and efficiencies implemented on the monitor badges.

• Apollo: Resolved access issues to non-DNAnexus S3 buckets.

• Apollo: Added DXDATA_CREATE_COHORT functionality to the product.

Release for 06-Apr-2021

• Fix to userDescribe functionality

• Fix to DBClusters

• Okta SCIM update

• Vulnerability patching

• Refactoring of SSO token exchange

• Apollo: Resolving issues accessing data in public S3 buckets, fixes for the data filters, and increased the efficiency of displaying tables in the User Interface

Release for 30-Mar-2021

• Refactoring user describe functionality to provide greater visibility to the org-admin

• Refactoring of minor User interface bugs

• Apollo: Minor fixes to the filters

Release for 23-Mar-2021

• Refactoring of the watermarking and UKB withdraws

• Refactoring of User Interfaces, including multiple wildcard support

• Apollo: refactoring of the Azure filesystem support and entity relationship filters

Release for 16-Mar-2021

• Refactoring of functional issues related to: update job pricing, updating autoscaling of cloud manager, fixes to the event emitter components, updates to analysis describe to get increased mapping, increase org-admin ability to assign roles within their role, and efficiency fixes to the watermarking API calls.

• Performance refactoring such as deletes on auto-throttled instances, fixes of updates to update describe for field mapping to the User Interfaces as well as removing deprecated instances out of the code base.

• User interface currency awareness

• User interface capability to upload directly from S3 and Blob storage

• Apollo: refactoring of issues arising from Azure filesystem

Release for 09-Mar-2021

• Supporting GPU and high memory instances on Azure

• Apollo: Now available on Azure (US-West)

• Refactoring of Titan to fix hanging and unassigned cluster jobs and related task management issues

• Updates to the dependencies of the Okta-SCIM servers

• Bugfixes to projectDescribe

• Expanding the ability to CLI ability to lower a job's priority to the UI

• Apollo: fixes to configuration tables on Azure. When a configuration table is incomplete, it is no longer flagged as an error.

Release for 02-Mar-2021

• Failed job restart fixes

• Implemented the autoscaling Cloud Manager in the AWS-London region for UKB RAWP

• Increased the granularity of reporting of Worker egress and access to heartbeat frequency

• Restricted ability to change addBilltoRegion

• File closer efficiency for files >1TB

• New worker types in Azure

• UI refactoring of bugs

• Fix issues with orchestration scripting for running cluster jobs, bare SQL supported

Release for 23-Feb-2021

• Cloud Manager on Azure updated for cluster jobs

• Fixes on UI components to limit length of org-names and improve display consistency

• Apollo: Cosmetic fixes to Scatterplot and refactoring filters in the query builder. Added "is-not" filter condition

Release for 16-Feb-2021

• Minor changes to org-design descriptor

• Additional logging info for terminated spot jobs on AWS

• Fixes to org-describe API to identify project calls for UKB RAP

• Node.js updated to v12 for archiving

• Apollo: Fixes to close database command and readfile cache. Added efficiencies for field selection UI activity

Release for 02-Feb-2021

• User Interface fixes in Cohort Browser

• Monthly security vulnerability patches, including the sudo vulnerability in Ubuntu

• Updates to node.js v12 for Execserver

• Apollo: fixes to vizserver and UI of the Cohort Browser

Release for 26-Jan-2021

• Additional enhancements to gather information from job fails to be captured in the audit log.

• Graphic redesign of the download proxy (allow folders and multiple files (up to 100) to be downloaded)

• Moving primary Authentication Server to Ubuntu 18.04

• Apollo: R-based Apollo Dataset SDK

• Apollo: Completion of filters

• Apollo: User interface efficiencies

Release for 12-Jan-2021

• Backend fixes to DBCluster

• UI fixes to project transfer flow

• UI vulnerability fix for PRSSI

Release for 05-Jan-2021

• Monthly updates to address infrastructure vulnerabilities

• Added one more access priv to HTTPS-worker (fix)

• Limiting Customer Cloud Account to specific API calls and security boundaries

• Backend changes to cloning files from the archive

• UI fixes to datamanager

• Apollo: refresh of apps on Apollo to address bugs

Release for 15-Dec-2020

• UI refactoring to address 3.0 re-route issue and a fix to allow the batch input selection

• Change to address email notifications when there are failed jobs. When massive failures occur from a workflow (more than thousands of jobs), email was sent for every job failure. This behavior will change to a limited set of emails focusing on the parent jobs only.

• Health checks on the internal Cloud Manager

• Transition of internal servers to node.js v12

• UI changes in for UK BioBank users

• Apollo: adding existential filter

Release for 08-Dec-2020

Cohort Browser

• Updating SendGrid emails (job status emails are processed via SendGrid)

• Updating SSL credentials for 2021

• UI fixes to allow the user to switch between Cohort Browsers

• UI fix for the processing of long and complicated workflows/pipelines

• Fix of job manager to accomodate detached jobs from appropriately licensed customers

• Add access to Jupyter Notebook Previewer via the UI

• Apollo: refactoring of the rsid filter

• Apollo: Allow for version switch to support Apache Spark V3.0.1

Release for 01-Dec-2020

• Fix for CanSeePrices to check the currency type (USD or GBP)

• Fix of issues in the download proxy

• Fix of the withdraw service for UK BioBank

• Efficiency and performance enhancements for job re-use functionality

• Update logic for price currency (USD and GBP)

• Adding functionality: DNA_API_RDS_CREATE_DBCluster, DNA_API_RDS_TERMINATE_DBCluster, DNA_API_RDS_USE_DBCluster for Titan

• Jupyter Notebook file viewer

• Apollo: Minor refactoring of the filters

Release for 16-Nov-2020

• Employing a shared image gallery for workers in AWS and Azure.

• Turn on autoscaling for the Cloud Manager in the AWS EU-West region only

• Correction on measuring the runtime of cluster jobs

• Refactoring of data dispensal issues

• UI refactoring of Data Manager and Cohort Browser to address issues

• Rollout of the Ubuntu 18.04 operating system to the internal services of DNAnexus

• Apollo: Refactoring reported issues with Apollo and documentation updates

Release for 10-Nov-2020

• Refactor of worker job limits to allow user to continue launching jobs until their user limit is exhausted in orgs where they have not hit their limit.

• Refactoring of association checker function

• Exposed data egress monitoring performed by the worker (broken out from overall data egress)

• Refactoring of issues of Cloud Manager on Azure spokes

• Patching of infrastructure vulnerabilities

• Updating the billing information to break out un-archiving charges from the archiving charges

• Apollo: refactoring issues

Release for 03-Nov-2020

• Add currency field to the job_analysis_describe command

• Initial fixes for the File Viewer for the Safari viewer (macOS native browser)

• Refactoring of the Cloud Manager log reporting into the SIEM (more information) and log rotation on the Cloud Managers

• Apollo: Refactoring reported issues with Apollo, including file status cache issues resolved, fixes to the helper method for exploding columns, and performance improvements

Release for 27-Oct-2020

• Job Manager and Cloud Manager autoscaling

• Detached Job functionality added

• Guard rail on number of objects to limit to less than 100,000 objects per command

• User Interface fixes to the login redirect URL

• Efficiencies for data dispensal application

• Apollo: refactoring reported issues

• Tools: Original Quality Functionality Equivalent app released

Release for 20-Oct-2020

• Refactoring of the Cloud Manager for efficiency and resolution of issues

• Refactoring for more efficient communication between the Job Manager and the internal API Server

• Make default the view of the archive data usage.

• Enable logging of API functions that call other API calls. This creates logging chains such as API_1 --> API_2 --> API_3

• User Interface Refactoring cleanup

• Apollo: Refactoring of reported issues, such as fixes when multiple spark clusters are using the same file and resource optimization

Release for 13-Oct-2020

• Refactoring of user describe functionality, lambda updates for performance, fixes to RegionIPRegions to map from the spokes to the user's IP space and improved efficiency of the archive state check functionality

• User interface performance fixes - specifically in the data manager

• Security vulnerabilities for infrastructure were patched

• node.js upgrades in the infrastructure

• Apollo: fixes to the scatter plot and dates of the histogram functionality. Fixes to parsing large files (> 2G).

Release for 06-Oct-2020

• Additional tuning of the Cloud manager for autoscaling

• Minor refactoring of "find" API call to return all possible items

• Data manager in the user interface will continue to show the Cohort Browser objects, but the size will no longer show the size of all related objects

• Ubuntu 20.04 is available for workers in all clouds (AWS and Azure) in all regions.

• Internal instances of nginx are upgraded to version 1.18

• Apollo: Additional refactoring to address issues with the Cohort Browser, version changes in dxdata, and entity support for boxplot

Release for 22-Sep-2020

• Additional tuning of the Cloud manager

• Internal refactoring to expand the user describe functionality for spot instances, kill-switch when jobs hit their pricing limitations, and additional reporting from the API servers

• Internal nginx servers upgraded to 1.18

• Apollo: additional refactoring to the Cohort Browser

Release for 15-Sep-2020

• Update of cloud Manager for autoscaling

• User Interface refactoring of known issues

• Apollo: Refactoring of locus controls, genomic range controls and decimals in the histogram

Release for 01-Sep-2020

• Refactor cloudmanager for VPC changes

• Refactoring of the operation of cluster computing in workflows

• Apollo: fixes to handling netstat error. Refactoring of the cluster packages and use of the appropriate signatures in Apollo components.

• Apollo: go live of Apollo in the London cloud for select customers.

Release for 25-Aug-2020

• Refactoring links between the Job Manager and API server

• Added DNA_API_PROVDER_DESCRIBE functionality to the Platform

• Addition of AWS-London cloud to DNAnexus environment for specific customers

• Vulnerability patching of the DNAnexus cloud infrastructure

• Apollo: Refactoring of V3 of data/time and max/min range of the histogram. Added boxplot explode functionality for hierarchical and multi-column selections

Release for 18-Aug-2020

• Refactoring of the autoscaling within the Platform

• User Interface refactoring (restoration of breadcrumbs in the data manager and highlighting)

• Apollo: upgrade of the VisZerver to the V3 distribution

Release for 11-Aug-2020

• Cloud Manager refactoring

• Updates to Grub2 and other security fixes

• Upgrades to Docker containers/pilot

• Apollo: backend changes to Histogram, ScatterPlot and descriptor functionality

Release for 04-Aug-2020

• Updates to internal servers - API Servers to Ubuntu 20.04

• Refactoring of database cluster in the infrastructure

• Refactoring of the project describe functionality to address issues

• Okta-SCIM updates (SSO for customers)

• Apollo: internal code to perform additional data payload verification tests, cohort code refactoring and updating dx-data in Docker.

Release for 28-Jul-2020

• User Interface Refactoring, including adding users to org by email, fixes to password complexity, UI footer style checks and a fix for a race condition occasionally seen when selecting folders.

• Cloud Manager refactoring

• Proxy Lock refactoring for the China region only.

• OktaSCIM changes

Release for 21-Jul-2020

• Updates to the external SSO - Okta SCIM

• Fix for the SQS SendMessage batch message length to allow for larger messages

• User Association Page

• Apollo testing framework update

Release for 14-Jul-2020

• Refactoring known user interface issues, fixes to data manager

• Routine updates of NVIDIA drivers for the AMI instances that use GPUs (includes security update)

• Fixed occasional bugs in upload proxy. Fixes to detached job issues

• Apollo: Refactoring of code to support V3

Release for 07-Jul-2020

• Enhancements for internal robustness of the https-worker client

• User interface refactoring, including changing the load spinner to reflect current brand colors

• Apollo: align ownership of internal files for smoother processing, updating panda and internal query routes. Updates on v3 of the updater and data loader.

Release for 30-Jun-2020

• Fix for jobeventsconsumer code for old objects

• Completed fix for JobManager API calls

• Update to https-workder to allow custom names

• Apollo: dxdata refactoring and added compatibility check when uploading data

Release for 23-Jun-2020

• Refactoring of the internal platform message queue to decrease the number of calls from the Redis server.

• Increase platform robustness by refactoring the jobEventQueue and Standard Queue

• User Interface refactoring in the data manager

• Apollo: Refactoring cluster log collection and arguments of the vizserver API. Fixes in the backend components to support the allele frequency functionality.

Release for 16-Jun-2020

• UI refactoring ("Pannexin"), including deprecation of unused code, fix for missing file size in file preview for image/pdf, refactoring of the data manager and fix of the range filtering in GWAS Manhattan dataset.

• Added government required links regarding contacts and abuse to the China cloud of DNAnexus.

• Refactoring of log rotation within the Platform

• Apollo: Changes of the vizserver to support the new software versi0ons in the backend, API refactoring and collection of logs in the Spark cluster.

Release for 9-Jun-2020

• Minor bugfixes in the Platform, including resolving symlinks and path handling

• User Interface switch between the legacy UI "Membrane" and newer UI "Pannexin"

• Disable public user from executing a user-describe functionality (security enhancement)

• FedRAMP email channel through Salesforce is activated

• Common password rejection

• Apollo: refactoring of API design, update error messages, date & time fixes, and upgrade to the HAR files

Release for 19-May-2020

• Refactoring Cohort Comparison Browser

• Move the legacy authentication server to Python 3

• Security fix for stylesheets

Release Notes for 05-May-2020

• Updates to the Okta SCIM SSO server

• Refactoring of the nginx web server on the worker AMIs to resolve existing issues

• Apollo: refactoring geno cohort filter

Release Notes for 28-Apr-2020

• Cookie notice will appear in compliance with EU requirements

• Minor fixes to node.js installers and packaging (internal)

• Refactoring of existing Cloudmanager to increase the monitoring scope

• Apollo: Added DNA_GUI_SURVIVAL_PLOT functionality in the Cohort Browser. Added support on Azure for the Thrift server integration from VizServer

Release Notes for 21-Apr-2020

• Refactoring of Cohort Browser and Companion browser, including max/min labels on charts, color changes in some icons

• Infrastructure refactoring to node.js installers and packaging.

Release Notes for 14-Apr-2020

Cohort Browser

• Internal refactoring of the Azure Cloud Manager to handle Docker containers

• UI refactoring for project list, set bill-to components, and Cohort Browser comparison

• Apollo: added DNA_GUI_COHORTCOMPARE_LOAD functionality

Release Notes for 07-Apr-2020

• Upgrade internal platform to Mongo 3.6 (in compatibility mode)

• UI changes to Manhattan plot zooming and refactoring of Cohort Browser/comparisons

• Apollo: Added TIP_APPS_PLATO_GWAS functionality

Release Notes for 31-Mar-2020

• New Lambda function for internal autoscaling

• Storage accounting updater daemon added (internal only)

• Upgrade the internal version of Python from 2.7 to 3.x

Release Notes for 24-Mar-2020

Cohort Browser

• Refactoring Pannexin User Interface. This includes fixing zeros that showed up in preview but held values.

• Update Okta-SCIM infrastructure

• Refactoring Cohort Browser

Release Notes for 17-Mar

Cohort Browser

• Upgrades and refactoring of the Cloudmanager on the Platform

• Refactoring to existing Cohort Browser. Improvements include list functionality, node search, and cohort comparison paging.

• Apollo: minor refactoring to address issues in the backend.

Release Notes for 10-Mar-2020

• Refactoring to existing Cohort Browser

• Security patches to the user interface

• Added the following functionality: DNA_GUI_DM_ELEMENT_CHECK, DNA_GUI_DM_NAVIGATION, DNA_GUI_SIDEBAR_OPEN, DNA_GUI_DM_INFO_TOGGLE, DNA_GUI_CUSTOMIZE_COLUMNS, DNA_GUI_FILTER_FIELDS, DNA_GUI_DM_CLEAR_FILTERS, DNA_GUI_DM_LOAD, DNA_GUI_DM_CREATE_NEW_FOLDER, DNA_GUI_DM_CREATE_NEW_WORKFLOW, DNA_GUI_DM_UPLOAD_FILE, DNA_GUI_DM_COPY_FROM_PROJECT, DNA_GUI_DM_START_ANALYSIS, DNA_GUI_DM_DEFAULT_ACTIONS

• Apollo: Added the following functionality: DNA_GUI_REMOVE_ALL_TILES

Release Notes for 03-Mar-2020

• Self-service archiving on Azure

• Python 3 rollout in Platform infrastructure

• Apollo: refactoring of existing code

Release for 25-Feb-2020

• Platform - refactoring of known issues

• Apollo: additional data loader functionality

Release for 11-Feb-2020

• Minor refactoring on the Platform and infrastructure for Azure and AWS clouds

• Apollo: minor refactoring of outstanding bugs in Vizserver

Release for 28-Jan-2020

• Upgrade internally to Ubuntu 16.04 (from Ubuntu 14.04)

• Refactoring of Apollo - minor bugfixes

Release for 14-Jan-2020

Cohort Browser

• Job Manager changes to allow Job Manager to talk to internal API servers via tokens

• Cluster job failure resolution - if there are multiple failures, will quit

• Refactoring of Cohort Browser at the UI level

• Apollo: Update to Python 3.7 in the backend

Release for 07-Jan-2020

• Refactoring s3deleter code

• Refactoring internal billing code

• Cloud Manager changes to support GPU instance types

• Pricing code changes for multi-region AWS archiving

• Apollo: Refactoring histogram functionality

• Apollo: Implementation across Azure (not just AWS)

Release for 17-Dec-2019

• Refactoring of archive modal iconf, data catalog page presentation fixes, UI efficiency improvements, add support for number format for 'e(+/-)', fix for the medusa update, data limits message clarified, documented tile requirements, fix Cohort Browser UI to allow dashboardConfig without any geno data components, fix filter pills overflow, remove usage of limits for charts from fieldsJSON and parallelize Jenkins tasks.

• Selective release of new functionality to support relational databases

• Apollo: Minor refactoring of sorting file parts before joining, link datasort from selected cohorts, set reverse DNS lookup to false, store genoBins in cohort details and update specific multi-part upload configs on Azure

Release for 10-Dec-2019

• Replace old DNAnexus logo on error pages

• Remove old archival code

• Apollo: refactoring binBy histogram code, license check code, and tipsync feature

Release for 03-Dec-2019

• Additional instances types added for DB Cluster

• File archiving in China

• UI changes

• File archiving refactoring

• Apollo: filter options

• Apollo: Looker sunset

Release for 05-Nov-2019

• Refactoring User Interface to include SSL headers

• Pages listing org-admins moved to the Pannexin user interface

• Enable GPU instances in China cloud

• Refactoring of the DB Cluster code

• Refactoring of the file archiving code

• Apollo: Minor refactoring of code and documentation

Release for 29-Oct-2019

• Extended refactoring of file archiving in areas such as timeouts, increased efficiencies, and storage optimization

• Add license checks to ensure files can be downloaded

• Refactoring of the Cohort Browser user interface.

• Horizontally scaling CloudManager to handle more concurrent workers by sharding within each instance type.

• Release of autoscaling of the authorization server to allow for high availability as the usage increases

• Apollo: Refactoring of select queries, trimming of caches, and performance enhancements

Release for 22-Oct-2019

• Refactoring of billing code about file archiving (internal functionality)

• Additional code to ensure the filenames of files to be archived have not already been archived

• Apollo: refactoring of Basic 2 variable charts

Release for 08-Oct-2019

• Refactoring self-service archiving, including the user interface and checks to make sure the files to be archived have not been deleted since the archiving process started

• Refactoring the CloudManager on AWS to handle more concurrent workers (via load balancers)

• User Interface refactoring in Pannexin for the Cohort Browser and customer-specific browsers

• Apollo: minor refactoring for database support on Azure.

Release for 01-Oct-2019

• Refactoring of the backend systems supporting Titan, including bugfixes for improvements, customer-specific user interface enhancements

• Apollo: Additional code buildout for local processing on Azure clouds, removal of code to access Looker (deprecated visualization module).

Release for 24-Sep-2019

Cohort Browser

• Refactoring of the user interface for improvements, customers-specific user interfaces.

• Apollo: code buildout for local processing on Azure clouds, improvements in the Cohort Browser

Release for 17-Sep-2019

• User Interface changes, including the overall look and feel, ain project folders and data selector.

• Refactoring in Titan, including refactoring Mongo queries, additional internal error messages, and diagnostics improvements

• Refactoring in Apollo around documentation and Mongo queries

Release for 10-Sep-2019

• Add authentication token and labels at the end of the human readable Audit Trail

• Change and add new instance classes (c.3.xlarge becomes c5.xlarge. New instance c5.9xlarge)

• Horizontal scaling of CloudManager to handle more concurrent workers (AWS only)

• Apollo: Minor refactoring of code supporting the viz server, API servers for list of folders and dxdownload support

Release for 27-Aug-2019

• Minor changes to the Platform U(ser) I(nterface) to support the use of the visualization server in Apollo

• Backend ability to push object to the archive (AWS only)

• Apollo: Minor changes to the vizserver (visualization server)

Release for 20-Aug-2019

• Refactoring DBCluster - fix where DBCluster gets stuck in "creating fix" step

• HITRUST certification received

• Feature switches - internally focused on billing

• Audit Log filenames - only for customers with "human readable" audit logs, files will have a prefix of YYMMDD to allow natural collation

• Apollo - revisions to Cohort Browser to enable multi-cohort charts

• Apollo - integrate additional variant annotation sources

Release for 13-Aug-2019

• Refactoring DBCluster code

• Refactoring of job manager user interface - should be faster

• Cleanup of the backend (not accessible to users) for Chart Builder, including support for importing CSV files

• Apollo: Cleanup and removal of mapping of Spark (full transfer to Spark 2.2)

Release for 09-Jul-2019

• User Interface - removing featured projects when there are no projects

• Refactoring internal Docker code

• Refactoring internal DBCluster code

• Apollo: batching filesystem deletes

Release for 25-Jun-2019

• Refactoring of memory lead issues related to file closers

• Refactoring of user interface for samples management in Cohort Browser

• Moving wiki links hardcoded into the UI to the DNAnexus Documentation site

• Apollo: SQS queuing for vizsync service

• Apollo: users can add multi-variate charts to the Cohort Browser

Release for 18-Jun-2019

• Apollo: Extending API Service module to get the SQL query from the Visualization Server

• Apollo: Refactoring of occasional 404 error from the Thrift Server

• Add DBCusterStart (relational database functionality) in CloudWatch

• Refactoring to correct assertion error when using findDataObjects when using SortBy filed.

• Expanded daemon to abandoned deleted files from a maximum of 1024 files to unlimited, after initial warning

• Refactoring race conditions in jobs finding files in workstation.

• Refactoring code for the community selector when the user has no communities

• Migrating Jenkins nucleus jobs from Ubuntu 14.04 to 16.04

• Downloading is stopped if the customer's account is out of money

Release for 11-Jun-2019

• Apollo Refactoring: Disable functions that are no longer used. This includes the reload function and getFunctions.

• Apollo Refactoring: Fix dataset sync for visualization between the API server and visualization serve

• Apollo Refactoring: Log the start/end time between API calls

• Apollo Refactoring: Fix the project feature access check

• Move lambda functions from node 6.10 (end of life) to 10.x

• Remove project file closer locking as this is no longer necessary

• Move lambda functions from node 6.10 (end of life) to 10.x

• Add archival billing events to stream to the billing apps

• Modify community login and registration pages to current branding as well as hidRegistration option

• Fix the page loading of Internet Explorer 11 (11.1087.16299.0) as well as an older version of Internet Explorer (11.0.9600.1784.eIS)

Release for 03-Jun-2019

• Apollo - Code to support sharding of relational databases. Default will be "off"

• Apollo - SQL fixes to Looker

• Apollo - Removing default of using vizserver as the default visualization service. User will need to specify visualization server

• Refactoring header authorization in the user interface

• Refactoring the code supporting community links on the Platform user interface

• Update dx-toolkit to 0.281.0

• Fix the internal tagging of the Docker images on the Platform

Release for 20-May-2019

• Minor revisions to the navigation bar in the header

• Internal replacement of the MongoDB storage system from MMAP technology to WiredTiger technology

• Refactoring of unarchive functionality

• Slight styles changes to the navigation bar (no changes to the functionally). User interface will move to v4 of WebPack.

• Apollo - bring your own database (BYOD) to now include JDBC drivers for Postgres, msSQL, MariaDB, MySQL, Amazon Redshift and Oracle

• Apollo - security update for Looker

Release for 14-May-2019

• Slight changes to the Platform toolbar

• Okta SSO account migration

• Refactoring costing model for the arcidAT command

• Refactoring of archive

• Create Docker service skeleton

• Apollo move throttle to the server

Release for 07-May-2019

• Refactoring of worker execution for slow jobs

• Refactoring of nucleus issues (fix of eventconsumer logging defect)

• Cohort Browser is moved to the standard Platform interface

• Apollo refactoring to return runtime file-ID from dashboards for saving cohorts

• Apollo Looker security update from v5.16.13 to v6.8.27 (latest)

• Refactoring LXC address documented change from LXC 2.0.8 to LXC 2.0.11

• Added larger instance type c5d.9xlarge

• Fixed NVIDIA driver load for p3.2xlarge instances

Release for 30-Apr-2019

• Clean up execserver code to address log truncation

• Enable /dev /tmpfs setup and clean up LXC

• Add archivedAt timestamp during the CloudArchival process

• Apollo - pooling http client connections for APIserver calls

• Apollo - refactor connection pool configurations for APIserver client on thrift and metastore

• Pannexin Tool Library Changes: improvements to the Tools Library, new user experience for the Tool Library whereby the information in /apps will be contained /panx/tools. /apps will go away. Tools Library now includes Global Workflows. Apps and Global Workflows launched through Tools Library will load in the new Tool Runner by default.

• Enable trusted org-admins to lock/unlock, reset MFA for their org users.

Release for 23-Apr-2019

• Web user interface can now run global workflows

• Additional fixes to DBCluster

• Provide a public IP address per worker on the Azure environment

• Port of Jobmanager to a Docker build base, which is based on Alpine

• Upgrade Docker to 18.09.5. Simplify Docker install

• Separate the license from Jupyter Lab from Apollo so they can be licensed separately

• Refactoring of code for the cloud archival containers

Release for 16-Apr-2019

• Integrate JupyterLab into the menu functionality of the web interface for the Platform

• Increase Node.js memory limit for the job log archiver service.

• Implement a container function to manage the archive process.

• Refactoring of Apollo code to address issues

Release for 09-Apr-2019

• Refactoring of findProject API call

• Support loading and interactive querying of full whole exome samples in Apollo

• Unique ID of the Thrift Server used written to the audit log (Apollo)

• Support for single node spark cluster (instead of requiring a minimum of 2 nodes)

• Updating the DNAnexus logos to new branding, primarily on CSS sheets of web pages

• Detect and report worker filesystem errors in the worker log file

• Refactoring of code to make sure archiving does not include symlinks

• fix for database sort memory limit with findProject memory limitation

Release for 02-Apr-2019

• File-level archive for API and CLI support to archive and unarchive files, folders and projects

• Fix to delete all files in scope on Azure

• Fixes for the internal DBCluster database files

• Pooling fo services on Apollo so that small jobs doe not get caught behind large jobs.

• Tuning of Prometheus sensing software

Release for 26-Mar-2019

• Apollo refactoring of reconnection, fix for ORC file formats and fix to make sure the error messages are correct.

• Platform to restrict the running of HTTPS apps

• Platform to upgrade NVIDIA driver on relevant workers

• Drone moved to the same VPC as Artifactory (no functionality change)

• Implement new billing events database

• fixes to bill for file archiving

Release for 05-Mar-2019

• Refactoring of the MongoDB timeout parameters

• Removing obsolete job group logging code from Apollo

• Refactoring of filter in the getUSER API call

Release for 26-Feb-2019

• Refactoring the m3.medium ephemeral disk space issue

• fixing learna for archiving common packages

• Updating the unarchived API logic

• adding autoscape hosts to perform platform_pilot_status

Release for 05-Feb-2019

• Adding internal metrics and alerts to the internal Audit Trails from the Platform.

• Refactoring the error handling in the MongoDB for metadata storage

• Phase out usage of describeSpotInstanceRequests as this is no longer being used

Release for 28-Jan-2019

• Refactor internal account for cluster jobs

• Refactor the file status caching logic for Apollo

Release for 21-Jan-2019

• Refactor internal authentication server

• Refactoring Azure-specific code for the Platform to make more efficient.

Release for 15-Jan-2019

• Refactoring the file closer functionality to address bugs.

• Additional monitoring code with Prometheus added to file uploader.

• Continued migration of existing SSO users to Okta SSO

Release for 08-Jan-2019

• Concurrent Org Worker Limits:All orgs that do not have custom concurrent worker limits will default to a maximum of 500 concurrent workers.

• Refactoring of API servers for Okta tokens (impacts only customers moving to Okta SSO)

• Refactoring of Nucleus for compatibility with MongoDB 3.4

• Refactoring to fix bugs in dx_download

Release for 18-Dec-2018

• Updates to the SCIM server for specific customers to integrate with the DNAnexus Platform Okta authentication server (no impact for all other customers)

Release for 11-Dec-2018

• Deprecated command line interface (CLI) commands dx sh and dx exit

• Internal refactoring of code, including adding internal monitoring and alerting functionality

Release for 04-Dec-2018

• Added i18n/I10n support to allow the user interface to recognize the user's language selection

Release for 27-Nov-2018

• Refactoring external API servers to support Ubuntu 16.04 and configure for autoscaling

• Ability of the user to archive without requiring support intervention (AWS-East only)

• Augmentation of the MongoDB server with AWS Aurora server (AWS only) for select customers

• Support for HTTPS access for JupyterLab

Release for 13-Nov-2018

• Updated the download proxy service to handle large volume of big files

• Movement of SSO functionality from the internal Auth Server to Okta for an existing customer

Release for 06-Nov-2018

• Custom expiration dates on tokens

• User's profile now allows email preferences

• Turned on the load balancer on the internal API server.

Release for 30-Oct-2018

• Upgraded the nginx webserver to V15

• Refactoring of the job manager to a high availability status

• Allowing users to see the public symlink URL

• Upgrade to REACT to V16 of the JavaScript library

Release for 23-Oct-2018

• Removed the social media links on the landing page of the Platform

• Alerts to org admins when the Audit Trail is turned off (a configuration setting)

Release for 9-Oct-2018

• Deployment of the Apollo functionality of the Translational Informatics Suite to appropriately licensed users

• Refactoring code for data egress

Release for 25-Sep-2018

• Refactoring of the beta-Apollo code (Translational Informatics Suite)

• Refactoring of data egress functionality