InstrumentsV2

Instrument presence classifier (taxonomy-based). This model can be used to detect which instruments are present and how strongly, and to localize those instruments over time via segments.

versionVersionrequired

Constant value: InstrumentsV2

Default value: InstrumentsV2

segments objectrequired

Segment-level scores for instruments.

timestampsSecondsnumber[]required

Possible values: >= 0

values objectrequired

Map of instrument tags → array of scores (aligned with timestampsSeconds).

accordionnumber[]required

Possible values: >= 0 and <= 1

acousticGuitarnumber[]required

Possible values: >= 0 and <= 1

africanPercussionnumber[]required

Possible values: >= 0 and <= 1

asianFlutenumber[]required

Possible values: >= 0 and <= 1

asianStringsnumber[]required

Possible values: >= 0 and <= 1

banjonumber[]required

Possible values: >= 0 and <= 1

bassnumber[]required

Possible values: >= 0 and <= 1

bassGuitarnumber[]required

Possible values: >= 0 and <= 1

bellsnumber[]required

Possible values: >= 0 and <= 1

bongoConganumber[]required

Possible values: >= 0 and <= 1

brassnumber[]required

Possible values: >= 0 and <= 1

celestenumber[]required

Possible values: >= 0 and <= 1

cellonumber[]required

Possible values: >= 0 and <= 1

churchOrgannumber[]required

Possible values: >= 0 and <= 1

clarinetnumber[]required

Possible values: >= 0 and <= 1

doubleBassnumber[]required

Possible values: >= 0 and <= 1

drumKitnumber[]required

Possible values: >= 0 and <= 1

electricGuitarnumber[]required

Possible values: >= 0 and <= 1

electricOrgannumber[]required

Possible values: >= 0 and <= 1

electricPianonumber[]required

Possible values: >= 0 and <= 1

electronicDrumsnumber[]required

Possible values: >= 0 and <= 1

flutenumber[]required

Possible values: >= 0 and <= 1

hornnumber[]required

Possible values: >= 0 and <= 1

glockenspielnumber[]required

Possible values: >= 0 and <= 1

harpnumber[]required

Possible values: >= 0 and <= 1

harpsichordnumber[]required

Possible values: >= 0 and <= 1

luteOudnumber[]required

Possible values: >= 0 and <= 1

mandolinnumber[]required

Possible values: >= 0 and <= 1

marimbanumber[]required

Possible values: >= 0 and <= 1

oboenumber[]required

Possible values: >= 0 and <= 1

percussionnumber[]required

Possible values: >= 0 and <= 1

pianonumber[]required

Possible values: >= 0 and <= 1

pizzicatonumber[]required

Possible values: >= 0 and <= 1

saxophonenumber[]required

Possible values: >= 0 and <= 1

sitarnumber[]required

Possible values: >= 0 and <= 1

steelDrumsnumber[]required

Possible values: >= 0 and <= 1

stringsnumber[]required

Possible values: >= 0 and <= 1

synthnumber[]required

Possible values: >= 0 and <= 1

tablanumber[]required

Possible values: >= 0 and <= 1

taikonumber[]required

Possible values: >= 0 and <= 1

trumpetnumber[]required

Possible values: >= 0 and <= 1

tubanumber[]required

Possible values: >= 0 and <= 1

ukulelenumber[]required

Possible values: >= 0 and <= 1

vibraphonenumber[]required

Possible values: >= 0 and <= 1

violinnumber[]required

Possible values: >= 0 and <= 1

whistlingnumber[]required

Possible values: >= 0 and <= 1

woodwindsnumber[]required

Possible values: >= 0 and <= 1

presence objectrequired

Track-level instrument presence categories keyed by instrument tags.

accordionInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

acousticGuitarInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

africanPercussionInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

asianFluteInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

asianStringsInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

banjoInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

bassInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

bassGuitarInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

bellsInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

bongoCongaInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

brassInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

celesteInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

celloInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

churchOrganInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

clarinetInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

doubleBassInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

drumKitInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

electricGuitarInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

electricOrganInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

electricPianoInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

electronicDrumsInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

fluteInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

hornInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

glockenspielInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

harpInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

harpsichordInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

luteOudInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

mandolinInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

marimbaInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

oboeInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

percussionInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

pianoInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

pizzicatoInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

saxophoneInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

sitarInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

steelDrumsInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

stringsInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

synthInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

tablaInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

taikoInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

trumpetInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

tubaInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

ukuleleInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

vibraphoneInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

violinInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

whistlingInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

woodwindsInstrumentsV2PresenceTagsrequired

Instrument presence tags.

Possible values: [absent, partially, frequently, throughout]

tagsInstrumentsV2Tags[]required

Possible values: [accordion, acousticGuitar, africanPercussion, asianFlute, asianStrings, banjo, bass, bassGuitar, bells, bongoConga, brass, celeste, cello, churchOrgan, clarinet, doubleBass, drumKit, electricGuitar, electricOrgan, electricPiano, electronicDrums, flute, horn, glockenspiel, harp, harpsichord, luteOud, mandolin, marimba, oboe, percussion, piano, pizzicato, saxophone, sitar, steelDrums, strings, synth, tabla, taiko, trumpet, tuba, ukulele, vibraphone, violin, whistling, woodwinds]

InstrumentsV2

{
  "version": "InstrumentsV2",
  "segments": {
    "timestampsSeconds": [
      0
    ],
    "values": {
      "accordion": [
        0
      ],
      "acousticGuitar": [
        0
      ],
      "africanPercussion": [
        0
      ],
      "asianFlute": [
        0
      ],
      "asianStrings": [
        0
      ],
      "banjo": [
        0
      ],
      "bass": [
        0
      ],
      "bassGuitar": [
        0
      ],
      "bells": [
        0
      ],
      "bongoConga": [
        0
      ],
      "brass": [
        0
      ],
      "celeste": [
        0
      ],
      "cello": [
        0
      ],
      "churchOrgan": [
        0
      ],
      "clarinet": [
        0
      ],
      "doubleBass": [
        0
      ],
      "drumKit": [
        0
      ],
      "electricGuitar": [
        0
      ],
      "electricOrgan": [
        0
      ],
      "electricPiano": [
        0
      ],
      "electronicDrums": [
        0
      ],
      "flute": [
        0
      ],
      "horn": [
        0
      ],
      "glockenspiel": [
        0
      ],
      "harp": [
        0
      ],
      "harpsichord": [
        0
      ],
      "luteOud": [
        0
      ],
      "mandolin": [
        0
      ],
      "marimba": [
        0
      ],
      "oboe": [
        0
      ],
      "percussion": [
        0
      ],
      "piano": [
        0
      ],
      "pizzicato": [
        0
      ],
      "saxophone": [
        0
      ],
      "sitar": [
        0
      ],
      "steelDrums": [
        0
      ],
      "strings": [
        0
      ],
      "synth": [
        0
      ],
      "tabla": [
        0
      ],
      "taiko": [
        0
      ],
      "trumpet": [
        0
      ],
      "tuba": [
        0
      ],
      "ukulele": [
        0
      ],
      "vibraphone": [
        0
      ],
      "violin": [
        0
      ],
      "whistling": [
        0
      ],
      "woodwinds": [
        0
      ]
    }
  },
  "presence": {
    "accordion": "absent",
    "acousticGuitar": "absent",
    "africanPercussion": "absent",
    "asianFlute": "absent",
    "asianStrings": "absent",
    "banjo": "absent",
    "bass": "absent",
    "bassGuitar": "absent",
    "bells": "absent",
    "bongoConga": "absent",
    "brass": "absent",
    "celeste": "absent",
    "cello": "absent",
    "churchOrgan": "absent",
    "clarinet": "absent",
    "doubleBass": "absent",
    "drumKit": "absent",
    "electricGuitar": "absent",
    "electricOrgan": "absent",
    "electricPiano": "absent",
    "electronicDrums": "absent",
    "flute": "absent",
    "horn": "absent",
    "glockenspiel": "absent",
    "harp": "absent",
    "harpsichord": "absent",
    "luteOud": "absent",
    "mandolin": "absent",
    "marimba": "absent",
    "oboe": "absent",
    "percussion": "absent",
    "piano": "absent",
    "pizzicato": "absent",
    "saxophone": "absent",
    "sitar": "absent",
    "steelDrums": "absent",
    "strings": "absent",
    "synth": "absent",
    "tabla": "absent",
    "taiko": "absent",
    "trumpet": "absent",
    "tuba": "absent",
    "ukulele": "absent",
    "vibraphone": "absent",
    "violin": "absent",
    "whistling": "absent",
    "woodwinds": "absent"
  },
  "tags": [
    "accordion"
  ]
}