App Metadata

The file dxapp.json is a DNAnexus application metadata file. Its presence in a directory tells DNAnexus tools that this directory contains DNAnexus app source code. The file's format is defined by convention and operationally by DNAnexus tools that use it (invoked through dx build and dx build --create-app).

The format of the file closely resembles that of the corresponding calls to /applet/new and /app/new, except for some differences as noted below. Fields found in dxapp.json but not recognized by the build tools are passed through to the API methods.

The next section is a detailed example showing most of the commonly used fields.

Annotated Example

The following lists the contents of an example dxapp.json to be provided in a directory for use with the dx build command. For fields that are marked for apps only, it is harmless to provide them when building applets. They only take effect when building apps.

Comments shown below are for reference only and are not valid in the JSON format.

{
  // (required) Simple name; cannot be changed across versions of an app
  "name": "mapper",
  // (required) Human-readable name (shown on the App's page and used as the
  // default job name)
  "title": "Simple Read Mapper",
  // (required) One-liner description of what the app(let) does
  "summary": "Maps reads to a genome",
  // (optional) Longer description of what the app(let) does; if not provided,
  // dx build will inline the Readme.md file if available
  "description": "This app...",
  // (optional) Detailed notes covering extra details; if not provided,
  // dx build will inline the Readme.developer.md file if available
  "developerNotes": "...",
  // (optional) This can contain arbitrary metadata, but there are some
  // key/value pairs that are recognized as conventions by the website
  // when rendering your app, e.g. for displaying contact information
  "details": {
    "contactEmail": "[email protected]"
  },
  // (required) The version of the API that your app uses
  "dxapi": "1.0.0",
  // (required) Apps only: version of the app that is being built
  "version": "0.0.1",
  // (optional) Apps only: list of categories describing the app (see
  // below for a list of recognized categories)
  "categories": ["Read Mapping"],
  // (required) Input specification (see API documentation)
  // An array:int input "1,2,3" would be launched with the input [1, 2, 3]
  // An array:string "1,2,3" would be launched with the input ["1", "2", "3"]
  "inputSpec": [
    {
      "name": "reads",
      "class": "file",
      "patterns": ["*.fastq", "*.fastq.gz"],
      "help": "Input FASTQ files ... ",
      "optional": false
    },
    {
      "name": "genomeindex_targz",
      "label": "BWA reference genome index",
      "help": "A file ...",
      "class": "file",
      "patterns": ["*.bwa-index.tar.gz"],
      "suggestions": [
        {
          "name": "DNAnexus Reference Genomes",
          "project": "project-BQpp3Y804Y0xbyG4GJPQ01xv",
          "path": "/"
        }
      ],
      "optional": false
    },
    {
      "name": "reads_type",
      "class": "string",
      "default": "paired-end",
      "choices": ["single-end", "paired-end"],
      "group": "Advanced Options"
    }
  ],
  // (required) Output specification (see API documentation)
  "outputSpec": [
    {
      "name": "mappings",
      "class": "file",
      "patterns": ["*.bam"]
    }
  ],
  // (required) Run specification (for more details, see the API documentation)
  "runSpec": {
    // Either "bash" or "python3" to indicate the interpreter for which
    // the script in "file" was written
    "interpreter": "python3",
    // Path to the script that will be run when this app(let) is run
    "file": "src/mapper.py",
    // (optional) Whether headJobOnDemand is enabled by default for this applet
    // or app. Can be overridden at runtime.
    "headJobOnDemand": true,
    // All entry points may be restarted if a restartable error occurs
    "restartableEntryPoints": "all",
    "assetDepends": [
      {
        // Asset bundle record ID
        "id": "record-Bq320600kXGxY7PyB43GZ69j"
      },
      {
        // (optional) Asset bundle record name
        "name": "qiime_asset",
        // (optional) Asset bundle record version number
        "version": "0.0.1",
        // (optional) ID of the project containing the asset bundle record
        "project": "project-Bq1pqV00kXGgzp45j4jGyYY7",
        // (optional) Folder in the project containing the asset bundle record.
        // By default the folder is "/"
        "folder": "/records"
      }
    ],
    // (optional, deprecated, moved to "regionalOptions") Request different
    // instance types for different entry points
    "systemRequirements": {
      // "main" here is the name of the entry point that is called when an
      // app(let) is run
      "main": {
        "instanceType": "mem1_ssd1_x4"
      },
      // "process" is the name of an entry point (used when spawning a new job
      // via /job/new that runs the function called "process")
      "process": {
        "instanceType": "mem3_ssd2_fpga1_x24",
        // FPGA driver to install on FPGA instances
        "fpgaDriver": "edico-1.4.9.2",
        // NVIDIA driver to install on GPU instances
        "nvidiaDriver": "R535"
      },
      // "analyze" demonstrates dynamic instance type selection. The system
      // attempts to provision instances from the instanceTypeSelector.allowedInstanceTypes
      // list in specified order.
      "analyze": {
        "instanceTypeSelector": {
          "allowedInstanceTypes": ["mem1_ssd1_x4", "mem1_ssd1_x8", "mem2_ssd1_x4"]
        }
      },
      // "*" indicates that the request applies to all other entry points
      // (when calling /job/new any function value other than "main", "process",
      // or "analyze")
      "*": {
        "instanceType": "mem3_ssd1_x4",
        // (optional) request a cluster of instances
        "clusterSpec": {
          // "dxspark", "apachespark","generic"
          "type": "dxspark",
          // "2.4.4" or "3.2.3" for spark, not present for generic
          "version": "3.2.3",
          // Size of the cluster (min 1) including the master
          "initialInstanceCount": 3,
          // (optional) Ports/port-ranges to open for communication between nodes
          // in the cluster
          "ports": "1000, 1100-1200",
          // (optional) Script to run on all nodes before running app code on
          // master node
          "bootstrapScript": "./bootstrap.sh"
        }
      }
    },
    // (optional) Options governing job restart policy
    "executionPolicy": {
      "restartOn": {
        // Restart automatically up to 3 times for system errors
        "*": 3
      }
    },
    // (optional) User-specified timeout policy for a job running this executable.
    // The default and max timeout is 30 days for orgs without the
    // allowJobsWithoutTimeout license. For orgs with the allowJobsWithoutTimeout
    // license, the default timeout value is null and is equivalent to no timeout.
    "timeoutPolicy": {
      // "main" here is the name of the entry point that is called when this
      // executable is run. The "main" entry point will timeout after 12 hours.
      "main": {
        "hours": 12
      },
      // "*" indicates that all other entry points except those explicitly
      // specified in `timeoutPolicy` (i.e. "main") will timeout after 4 hours
      // 30 minutes.
      "*": {
        "hours": 4,
        "minutes": 30
      }
    },
    // The flavor of Linux that your app(let) will run on. Supported value: "Ubuntu"
    "distribution": "Ubuntu",
    // The release of the Linux distribution your app(let) will run on.
    // Supported values: "24.04" and "20.04".
    "release": "24.04",
    // Default: "0". A triplet of (distribution, release, version)
    // uniquely identifies an application execution environment. Supported versions:
    // ("Ubuntu","24.04","0") and ("Ubuntu","20.04","0")
    "version": "0",
    // (optional) A list of packages that your app(let) requires to be
    // installed before it can be run
    "execDepends": [
      {
        // "samtools" is an APT package name (other package managers also
        // supported; see documentation on the run specification for details)
        "name": "samtools"
      }
    ]
  },
  // (optional, deprecated, moved to the "regionalOptions" field) Apps only: request
  // some resource(s) to be made (privately) accessible to the app when it is run;
  // can be a project ID or a list of data object IDs. It can be used only for apps
  // enabled in a single region and when "regionalOptions" field is not specified.
  "resources": "project-BBF4Jp80vVky55Vvgkb0028v",
  // (optional) Whether to allow Smart Reuse for this applet or app.
  // Default is false (reuse allowed). Can be overridden at runtime using the flags
  // --ignore-reuse (sets true) or --extra-args (can set true or false).
  "ignoreReuse": true,
  // (optional) Apps only: Whether the contents of this app version's
  // resources container should be viewable by all members of the app's
  // developers and authorized users
  "openSource": true,
  // (optional) externally expose jobs to the internet via an HTTPS proxy
  // at https://job-xxxx.dnanexus.cloud/
  "httpsApp": {
    // Array of ports to allow access. Allowed values are 443, 8080, 8081
    "ports": [443, 8080, 8081],
    // Restrict access to users with project access VIEW, CONTRIBUTE, ADMINISTER,
    // or NONE to limit to the launching user
    "shared_access": "VIEW"
  },
  // (optional) Request that the app(let) be given additional access
  // permissions
  "access": {
    // (optional) Give the app(let) CONTRIBUTE access to the project in
    // which it is run. By default, an app will receive NO access, or if
    // you build this as an applet, it will receive VIEW access.
    "project": "CONTRIBUTE",
    // (optional) Give the app(let) VIEW access to all projects that the
    // user running the app can access. Use this carefully.
    "allProjects": "VIEW",
    // (optional) Give the app(let) network access to all domains; you can
    // also list specific domains such as "github.com".
    "network": [
      "*"
    ],
    // (optional) Give the app(let) permissions to act as a developer on
    // behalf of the user (e.g. it will be able to create new apps and
    // access unpublished apps)
    "developer": true
  },
  // (optional) Apps only: these users will be allowed to publish new versions of
  // this app and perform other administrative functions.
  "developers": [
    "user-you"
  ],
  // (optional) Apps only: any published version of this app will be runnable by the
  // developers of the app, and by user-alice and user-bob. (Access to an applet
  // is determined by access to the project containing the applet.)
  "authorizedUsers": [
    "user-alice",
    "user-bob"
  ],
  // (optional) In the case of apps, set this field to allow your app to be run in more
  // than one region. Provide as keys all the regions in which you wish the
  // app to be enabled. At a minimum, supply an empty object mapping {}
  // as the corresponding value. Within each value, you may also supply
  // any of the keys "systemRequirements", "bundledDepends",
  // "assetDepends", or "resources". The corresponding values will be treated
  // as if you had supplied them in the run specification above, but only
  // for the associated region.
  //
  // In the case of applets: request specific "systemRequirements"
  // in the region in which the applet will be built.
  //
  // You can use this to request different instance types that might be
  // available in different clouds, or to supply copies of app resources
  // that are colocated with the specific region where the app will be run.
  "regionalOptions": {
    "aws:us-east-1": {
      "systemRequirements": {"*": {"instanceType": "mem2_ssd1_x2"}},
      "bundledDepends": [{"name": "bundle.tar.gz", "id": {"$dnanexus_link": "file-xxxx"}}],
      "assetDepends": [{"id": "record-yyyy"}],
      "resources": "project-zzzz"
    },
    "azure:westus": {
      "systemRequirements": {"*": {"instanceType": "azure:mem2_ssd1_x2"}},
      "bundledDepends": [{"name": "bundle.tar.gz", "id": {"$dnanexus_link": "file-zzzz"}}],
      "assetDepends": [{"id": "record-aaaa"}],
      "resources": ["file-aaaa", "file-bbbb"]
    }
  }
}

Other options for the /applet/new and /app/new calls, such as specifying in which project or folder to create an applet, are populated via command-line flags of dx build.

Specification

name

The name string The unique name of the applet / app. The name can have lower case letters, numbers, -, and _ but cannot have spaces.

If the applet is published into an app, then its ID is of the form app-[name]/[version]. An app's name cannot be changed across versions.

Example:

{
  "name": "bwa_mem_fastq_read_mapper",
}

title

title string (optional) A human-readable name of the app(let). If published as an app, this name is shown on the Apps page and as the default job name.

Example:

{
  "title": "BWA-MEM FASTQ Read Mapper",
}

summary

summary string (optional) A one-liner description of the app(let). If published as an app, this summary is displayed under the app name on the Apps page.

Example:

{
  "summary": "Maps FASTQ reads to a reference genome with the BWA-MEM algorithm.",
}

description

description string (optional) Longer description of what the app(let) does. If not provided, dx build includes the Readme.md file content, if available.

Example:

{
  "description": "This app maps FASTQ reads to a reference genome ... inputs ...",
}

developerNotes

developerNotes string (optional) Detailed notes covering extra details. If not provided, dx build includes the Readme.developer.md file content, if available.

Example:

{
  "developerNotes": "...",
}

details (Developer and Contact Info, and Other Metadata)

details string (optional) This can contain arbitrary metadata, but there are some key/value pairs that are recognized as conventions by the website when rendering your app, for example, for displaying contact information. Recognized metadata fields include the following:

• Author contact information

• Upstream executable version number, such as bwa-mem 0.7.12

• Upstream author name

• URL for app executable

• Upstream licenses

• Change Log

• Citations for papers

Example:

{
  "details": {
    "contactEmail": "[email protected]",
    "citations": [ "doi:10.1093/bioinformatics/btp352"],
    "upstreamVersion": "0.9.12",
    "upstreamAuthor": "Alice Bob",
    "upstreamUrl": "http://example.com/",
    "upstreamLicenses": ["GLPv3"],
    "whatsNew": "## Changelog\n* Optionally markdown formated"
  }
}

dxapi

dxapi string (optional) The version of the API that your app uses.

Example:

{
  "dxapi": "1.0.0",
}

version

version string Apps only: The version of the app to be built identifying each build of your app. This version number must be unique from all other versions of the app (published or not).

We recommend following the Semantic Versioning conventions for numbering app versions. Semantic Versioning specifies how to change the version number for specific types of updates to an app. This includes bug-fix-only updates, backwards-compatible changes, or backwards-incompatible modifications. Following Semantic Versioning helps users and other developers understand when it is safe to move between different versions of your app.

Example:

{
  "version": "3.1.41-rc.1",
}

categories (User-Browseable Categories)

You can specify any categories you wish for your app in the "categories" field of the dxapp.json. However, the following categories are specially recognized by DNAnexus, and authorized users of your app can use them to browse for your app in the App Store if you specify any of them:

• Annotation

• Assembly

• Debugging

• Export

• Import

• Mappings Manipulation

• Read Manipulation

• Read Mapping

• Reports

• RNA-Seq

• Statistics

• Structural Variation

• Variation Calling

Example:

{
  "categories": [
    "Read Mapping"
  ],
}

inputSpec and outputSpec

JSON array that specifies app inputs. These fields are required for apps and strongly recommended for applets. For complete details on input and output specifications, see I/O and Run Specifications.

If you omit the inputSpec or outputSpec fields from an applet, the system does not validate the inputs or outputs for that applet. However, applets without both an input and output specification cannot be added as a stage in a workflow.

runSpec (Entry Point and Dependencies)

The runSpec field specifies your app's entry and the interpreter used to evaluate it:

{
  "runSpec": {
    "interpreter": "python3",
    "file": "src/code.py"
  }
}

In the above example, the "runSpec.file" parameter provides the path to a Python file that contains your application logic.

In this case, the example provides Python code (code.py) that uses the DNAnexus Python 3 execution template (indicated in the interpreter field). This template takes care of parsing your app's input from the DNAnexus execution environment, handling possible errors, and saving your app's output. See the example applications for examples of the entry point Python function signatures.

For more details about execution templates and running code in the execution environment, see the Execution Environment Reference.

access field (App Permissions)

By default, apps have limited access to data to ensure user privacy and reproducibility. However, you can request additional permissions for your app when needed.

For a complete list of available permission options, see I/O and Run Specifications.

To learn more about different permission types and their implications, see App Permissions.

authorizedUsers field (Who Can Access Your App)

You can specify who can describe and run your app by providing a list of users. The default access list is the empty list [], which indicates that no one except the developers of the app can find and run your app, even if it has been published. You may provide a list of users and/or organizations here to grant them access the app.

The access list is shared for all past and future versions of the app but can be modified at any time. If you need to create another version of your app with a different access list, you need to publish it separately under a different name.

You can also edit the list of authorized users after you've built and published an app by using the dx add users and dx remove users commands. However, if you (or another developer) rebuilds the app with authorizedUsers in the dxapp.json file, the access list is overwritten to match the one found in the file.

regionalOptions field (Where Can Your App Run)

You can specify what regions the app can be run in, and specify advanced options that control the app's behavior in multiple regions. The regionalOptions field should be a mapping with keys corresponding to each region in which the app should be runnable. (A region is given by a string like aws:region-code. See Regions for more information about regions.) If you don't specify this field, the app is enabled in only one region: the region of your project context when the app is built.

The values associated with each key are themselves mappings. In the most basic usage, you can specify an empty mapping for each region. This is generally sufficient to allow apps that don't use certain advanced features to be run in multiple regions.

For apps that use bundled dependencies, additional resources, or specify that they should run on specific instance types, each value of regionalOptions may contain the following keys and values:

• systemRequirements mapping Request specific instance types and (optional) define a clusterSpec for some entry points of the app when it is run in the corresponding region.

• bundledDepends list bundled dependencies for the corresponding region. For the syntax of this field, see the discussion of bundledDepends in the run specification.

• assetDepends list asset dependencies for the corresponding region. See the assetDepends field above for the syntax of this field.

• resources string or array of strings Either a string containing the ID of a project to be used as a resources container, or an array of data object IDs. These objects are cloned into the root folder of the resources container. All specified objects must reside in the specified region and are available to the app when it is run in that region.

If you specify a value for a key, such as systemRequirements, you must do so in all regions, and you may not specify the same key in the run specification.