Répertoire de publications
de recherche en accès libre
de recherche en accès libre
Clausecker, Robert et Lemire, Daniel (2023). Transcoding Unicode Characters with AVX-512 Instructions. Software: Practice and Experience, 53 (12). https://doi.org/10.1002/spe.3261
Fichier(s) associé(s) à ce document :
PDF
- simdutfavx512.pdf
Contenu du fichier : Manuscrit soumis (avant évaluation) Licence : Creative Commons CC BY. |
|
Catégorie de document : | Articles de revues |
---|---|
Évaluation par un comité de lecture : | Oui |
Étape de publication : | Publié |
Résumé : | Intel includes in its recent processors a powerful set of instructions capable of processing 512-bit registers with a single instruction (AVX-512). Some of these instructions have no equivalent in earlier instruction sets. We leverage these instructions to efficiently transcode strings between the most common formats: UTF-8 and UTF-16. With our novel algorithms, we are often twice as fast as the previous best solutions. For example, we transcode Chinese text from UTF-8 to UTF-16 at more than 5 GiB/s using fewer than 2 CPU instructions per character. To ensure reproducibility, we make our software freely available as an open source library. Our library is part of the popular Node.js JavaScript runtime. |
Adresse de la version officielle : | https://onlinelibrary.wiley.com/doi/10.1002/spe.32... |
Déposant: | Lemire, Daniel |
Responsable : | Daniel Lemire |
Dépôt : | 07 août 2023 20:26 |
Dernière modification : | 11 nov. 2023 10:12 |
RÉVISER |