{"id":333,"date":"2021-09-13T13:49:00","date_gmt":"2021-09-13T11:49:00","guid":{"rendered":"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/"},"modified":"2023-08-09T15:32:40","modified_gmt":"2023-08-09T13:32:40","slug":"nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise","status":"publish","type":"post","link":"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/","title":{"rendered":"NLP : Qwant pr\u00e9sente un nouveau mod\u00e8le BERT compact en langue fran\u00e7aise"},"content":{"rendered":"

Avez-vous entendu parler du NLP ?<\/p>\n

Le \u00ab Natural Language Processing \u00bb (Traitement Automatique des Langues, en fran\u00e7ais) est un domaine de recherche pluridisciplinaire appliqu\u00e9 visant \u00e0 mettre au point des outils de traitement automatique des langues capables de r\u00e9pondre \u00e0 une large gamme d’applications. <\/strong><\/p>\n

Parmi ces derni\u00e8res, on retrouve un grand nombre d’applications utiles au quotidien et bien connues du grand public : la reconnaissance vocale<\/strong>, la compr\u00e9hension de textes<\/strong>, la traduction<\/strong>, la classification th\u00e9matique<\/strong> de documents, et bien d’autres encore.<\/p>\n

Tout l’enjeu (et la beaut\u00e9) du NLP est de faire comprendre le langage humain \u00e0 des machines afin de leur permettre d’interagir avec nous. Si vous souhaitez en savoir plus sur cette technologie et les travaux men\u00e9s par les \u00e9quipes de Qwant, nous vous invitons \u00e0 lire cet article qui faisait suite \u00e0 la conf\u00e9rence Coling sur le sujet.<\/a><\/p>\n

Avec la publication par Oralie Cattan, doctorante, et Christophe Servan, responsable scientifique chez Qwant <\/strong>et d’autres chercheurs d’un article de recherche portant sur l\u2019utilisabilit\u00e9 des mod\u00e8les BERT pour le fran\u00e7ais, les \u00e9quipes de recherche de Qwant franchissent une \u00e9tape suppl\u00e9mentaire dans l’application des sciences \u00e0 l’am\u00e9lioration de la vie quotidienne. Ces mod\u00e8les compacts, moins gourmands en donn\u00e9es, avaient jusqu’alors principalement \u00e9t\u00e9 propos\u00e9s en anglais.<\/p>\n

Mais ce n’est pas tout ! Oralie et Christophe y pr\u00e9sentent aussi un nouveau mod\u00e8le BERT compact pour le fran\u00e7ais, d\u00e9velopp\u00e9 au sein de Qwant, r\u00e9pondant au nom de \u00ab FrALBERT \u00bb et disponible sur HuggingFace<\/a>. C\u2019est une performance, puisque ce mod\u00e8le compact, utilisant \u00ab seulement \u00bb 12 millions de param\u00e8tres, est un des rares mod\u00e8le BERT compact applicable \u00e0 la langue fran\u00e7aise \u00e0 exister.<\/strong> De plus, il fut entra\u00een\u00e9 gr\u00e2ce \u00e0 la puissance de calcul dont dispose Qwant en interne<\/strong>. Les deux principaux mod\u00e8les BERT fran\u00e7ais existants jusqu’alors sont plus gros (+ de 110 millions param\u00e8tres !), et ont n\u00e9cessit\u00e9 l\u2019utilisation d\u2019un supercalculateur (p.ex : Jean Zay ou \u00e0 travers un partenariat avec un GAFAM).<\/p>\n

Les \u00e9quipes de Qwant s\u2019unissent pour f\u00e9liciter Oralie Cattan et Christophe Servan et r\u00e9affirmer leur attachement aux valeurs du progr\u00e8s par la science et la connaissance.<\/p>\n

Pour en savoir plus : publication scientifique: “On the Usability of Transformers-based models for a French Question-Answering task” <\/a>\/ HuggingFace<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Les \u00e9quipes de recherche de Qwant franchissent une \u00e9tape suppl\u00e9mentaire dans l’application des sciences \u00e0 l’am\u00e9lioration de la vie quotidienne avec la publication d’un nouveau mod\u00e8le BERT. <\/p>\n","protected":false},"author":22,"featured_media":334,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[14,8,18],"yoast_head":"\nNLP : Qwant pr\u00e9sente un nouveau mod\u00e8le BERT compact en langue fran\u00e7aise - Better Web<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"NLP : Qwant pr\u00e9sente un nouveau mod\u00e8le BERT compact en langue fran\u00e7aise - Better Web\" \/>\n<meta property=\"og:description\" content=\"Les \u00e9quipes de recherche de Qwant franchissent une \u00e9tape suppl\u00e9mentaire dans l'application des sciences \u00e0 l'am\u00e9lioration de la vie quotidienne avec la publication d'un nouveau mod\u00e8le BERT.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/\" \/>\n<meta property=\"og:site_name\" content=\"Better Web\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/Qwantcom\/\" \/>\n<meta property=\"article:author\" content=\"qwantcom\" \/>\n<meta property=\"article:published_time\" content=\"2021-09-13T11:49:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-08-09T13:32:40+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/betterweb.qwant.com\/wp-content\/uploads\/sites\/3\/2021\/09\/peter-gombos-8y3e2M6APy4-unsplash.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"2000\" \/>\n\t<meta property=\"og:image:height\" content=\"1333\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Team Qwant\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Qwant_FR\" \/>\n<meta name=\"twitter:site\" content=\"@Qwant_FR\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"Team Qwant\" \/>\n\t<meta name=\"twitter:label2\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/\"},\"author\":{\"name\":\"Team Qwant\",\"@id\":\"https:\/\/betterweb.qwant.com\/#\/schema\/person\/4ff0b8b899e0358152323449e60bce83\"},\"headline\":\"NLP : Qwant pr\u00e9sente un nouveau mod\u00e8le BERT compact en langue fran\u00e7aise\",\"datePublished\":\"2021-09-13T11:49:00+00:00\",\"dateModified\":\"2023-08-09T13:32:40+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/\"},\"wordCount\":405,\"publisher\":{\"@id\":\"https:\/\/betterweb.qwant.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/betterweb.qwant.com\/wp-content\/uploads\/sites\/3\/2021\/09\/peter-gombos-8y3e2M6APy4-unsplash.jpeg\",\"keywords\":[\"#FR\",\"Research\",\"tech\"],\"articleSection\":[\"Tech\"],\"inLanguage\":\"fr-FR\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/\",\"url\":\"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/\",\"name\":\"NLP : Qwant pr\u00e9sente un nouveau mod\u00e8le BERT compact en langue fran\u00e7aise - Better Web\",\"isPartOf\":{\"@id\":\"https:\/\/betterweb.qwant.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/betterweb.qwant.com\/wp-content\/uploads\/sites\/3\/2021\/09\/peter-gombos-8y3e2M6APy4-unsplash.jpeg\",\"datePublished\":\"2021-09-13T11:49:00+00:00\",\"dateModified\":\"2023-08-09T13:32:40+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/#primaryimage\",\"url\":\"https:\/\/betterweb.qwant.com\/wp-content\/uploads\/sites\/3\/2021\/09\/peter-gombos-8y3e2M6APy4-unsplash.jpeg\",\"contentUrl\":\"https:\/\/betterweb.qwant.com\/wp-content\/uploads\/sites\/3\/2021\/09\/peter-gombos-8y3e2M6APy4-unsplash.jpeg\",\"width\":2000,\"height\":1333},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\/\/betterweb.qwant.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"NLP : Qwant pr\u00e9sente un nouveau mod\u00e8le BERT compact en langue fran\u00e7aise\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/betterweb.qwant.com\/#website\",\"url\":\"https:\/\/betterweb.qwant.com\/\",\"name\":\"Better Web\",\"description\":\"Le blog du moteur de recherche qui ne sait rien sur vous\",\"publisher\":{\"@id\":\"https:\/\/betterweb.qwant.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/betterweb.qwant.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/betterweb.qwant.com\/#organization\",\"name\":\"Better Web\",\"url\":\"https:\/\/betterweb.qwant.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/betterweb.qwant.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/betterweb.qwant.com\/wp-content\/uploads\/sites\/3\/2024\/05\/Qwant-Better-web-vertical.svg\",\"contentUrl\":\"https:\/\/betterweb.qwant.com\/wp-content\/uploads\/sites\/3\/2024\/05\/Qwant-Better-web-vertical.svg\",\"width\":146,\"height\":54,\"caption\":\"Better Web\"},\"image\":{\"@id\":\"https:\/\/betterweb.qwant.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/Qwantcom\/\",\"https:\/\/x.com\/Qwant_FR\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/betterweb.qwant.com\/#\/schema\/person\/4ff0b8b899e0358152323449e60bce83\",\"name\":\"Team Qwant\",\"sameAs\":[\"http:\/\/www.qwant.com\",\"qwantcom\",\"https:\/\/x.com\/@Qwant_FR\"],\"url\":\"https:\/\/betterweb.qwant.com\/author\/teamqwant-2\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"NLP : Qwant pr\u00e9sente un nouveau mod\u00e8le BERT compact en langue fran\u00e7aise - Better Web","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/","og_locale":"fr_FR","og_type":"article","og_title":"NLP : Qwant pr\u00e9sente un nouveau mod\u00e8le BERT compact en langue fran\u00e7aise - Better Web","og_description":"Les \u00e9quipes de recherche de Qwant franchissent une \u00e9tape suppl\u00e9mentaire dans l'application des sciences \u00e0 l'am\u00e9lioration de la vie quotidienne avec la publication d'un nouveau mod\u00e8le BERT.","og_url":"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/","og_site_name":"Better Web","article_publisher":"https:\/\/www.facebook.com\/Qwantcom\/","article_author":"qwantcom","article_published_time":"2021-09-13T11:49:00+00:00","article_modified_time":"2023-08-09T13:32:40+00:00","og_image":[{"width":2000,"height":1333,"url":"https:\/\/betterweb.qwant.com\/wp-content\/uploads\/sites\/3\/2021\/09\/peter-gombos-8y3e2M6APy4-unsplash.jpeg","type":"image\/jpeg"}],"author":"Team Qwant","twitter_card":"summary_large_image","twitter_creator":"@Qwant_FR","twitter_site":"@Qwant_FR","twitter_misc":{"\u00c9crit par":"Team Qwant","Dur\u00e9e de lecture estim\u00e9e":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/#article","isPartOf":{"@id":"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/"},"author":{"name":"Team Qwant","@id":"https:\/\/betterweb.qwant.com\/#\/schema\/person\/4ff0b8b899e0358152323449e60bce83"},"headline":"NLP : Qwant pr\u00e9sente un nouveau mod\u00e8le BERT compact en langue fran\u00e7aise","datePublished":"2021-09-13T11:49:00+00:00","dateModified":"2023-08-09T13:32:40+00:00","mainEntityOfPage":{"@id":"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/"},"wordCount":405,"publisher":{"@id":"https:\/\/betterweb.qwant.com\/#organization"},"image":{"@id":"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/#primaryimage"},"thumbnailUrl":"https:\/\/betterweb.qwant.com\/wp-content\/uploads\/sites\/3\/2021\/09\/peter-gombos-8y3e2M6APy4-unsplash.jpeg","keywords":["#FR","Research","tech"],"articleSection":["Tech"],"inLanguage":"fr-FR"},{"@type":"WebPage","@id":"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/","url":"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/","name":"NLP : Qwant pr\u00e9sente un nouveau mod\u00e8le BERT compact en langue fran\u00e7aise - Better Web","isPartOf":{"@id":"https:\/\/betterweb.qwant.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/#primaryimage"},"image":{"@id":"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/#primaryimage"},"thumbnailUrl":"https:\/\/betterweb.qwant.com\/wp-content\/uploads\/sites\/3\/2021\/09\/peter-gombos-8y3e2M6APy4-unsplash.jpeg","datePublished":"2021-09-13T11:49:00+00:00","dateModified":"2023-08-09T13:32:40+00:00","breadcrumb":{"@id":"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/"]}]},{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/#primaryimage","url":"https:\/\/betterweb.qwant.com\/wp-content\/uploads\/sites\/3\/2021\/09\/peter-gombos-8y3e2M6APy4-unsplash.jpeg","contentUrl":"https:\/\/betterweb.qwant.com\/wp-content\/uploads\/sites\/3\/2021\/09\/peter-gombos-8y3e2M6APy4-unsplash.jpeg","width":2000,"height":1333},{"@type":"BreadcrumbList","@id":"https:\/\/betterweb.qwant.com\/2021\/09\/13\/nlp-qwant-presente-le-premier-modele-bert-en-langue-francaise\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/betterweb.qwant.com\/"},{"@type":"ListItem","position":2,"name":"NLP : Qwant pr\u00e9sente un nouveau mod\u00e8le BERT compact en langue fran\u00e7aise"}]},{"@type":"WebSite","@id":"https:\/\/betterweb.qwant.com\/#website","url":"https:\/\/betterweb.qwant.com\/","name":"Better Web","description":"Le blog du moteur de recherche qui ne sait rien sur vous","publisher":{"@id":"https:\/\/betterweb.qwant.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/betterweb.qwant.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"fr-FR"},{"@type":"Organization","@id":"https:\/\/betterweb.qwant.com\/#organization","name":"Better Web","url":"https:\/\/betterweb.qwant.com\/","logo":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/betterweb.qwant.com\/#\/schema\/logo\/image\/","url":"https:\/\/betterweb.qwant.com\/wp-content\/uploads\/sites\/3\/2024\/05\/Qwant-Better-web-vertical.svg","contentUrl":"https:\/\/betterweb.qwant.com\/wp-content\/uploads\/sites\/3\/2024\/05\/Qwant-Better-web-vertical.svg","width":146,"height":54,"caption":"Better Web"},"image":{"@id":"https:\/\/betterweb.qwant.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/Qwantcom\/","https:\/\/x.com\/Qwant_FR"]},{"@type":"Person","@id":"https:\/\/betterweb.qwant.com\/#\/schema\/person\/4ff0b8b899e0358152323449e60bce83","name":"Team Qwant","sameAs":["http:\/\/www.qwant.com","qwantcom","https:\/\/x.com\/@Qwant_FR"],"url":"https:\/\/betterweb.qwant.com\/author\/teamqwant-2\/"}]}},"_links":{"self":[{"href":"https:\/\/betterweb.qwant.com\/wp-json\/wp\/v2\/posts\/333"}],"collection":[{"href":"https:\/\/betterweb.qwant.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/betterweb.qwant.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/betterweb.qwant.com\/wp-json\/wp\/v2\/users\/22"}],"replies":[{"embeddable":true,"href":"https:\/\/betterweb.qwant.com\/wp-json\/wp\/v2\/comments?post=333"}],"version-history":[{"count":1,"href":"https:\/\/betterweb.qwant.com\/wp-json\/wp\/v2\/posts\/333\/revisions"}],"predecessor-version":[{"id":469,"href":"https:\/\/betterweb.qwant.com\/wp-json\/wp\/v2\/posts\/333\/revisions\/469"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/betterweb.qwant.com\/wp-json\/wp\/v2\/media\/334"}],"wp:attachment":[{"href":"https:\/\/betterweb.qwant.com\/wp-json\/wp\/v2\/media?parent=333"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/betterweb.qwant.com\/wp-json\/wp\/v2\/categories?post=333"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/betterweb.qwant.com\/wp-json\/wp\/v2\/tags?post=333"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}