Search from vocabulary

Lengua del contenido

Concept information

Término preferido

tokenisation  

Definición

  • turning a sequence of characters (a text) into a sequence of occurrences of inflected word forms and interpunction symbols (often called 'tokens')

Concepto genérico

URI

https://vocabs.sshopencloud.eu/vocabularies/csd-tool-tasks/0102

Descargue este concepto:

RDF/XML TURTLE JSON-LD última modificación 2/1/24