Finnish conversational chat corpus

The corpus contains 85 Finnish chat dialogs which have been collected during 2019-2020. 62 Participants were university staff, university students and high schoolers. For more detailed information, see the article listed below.

Please cite the following paper when using the corpus: K. Leino, J. Leinonen, M. Singh, S. Virpioja and M. Kurimo. ”FinChat: Corpus and evaluation setup for Finnish chat conversations on everyday topics.” INTERSPEECH. 2020.

Link: https://github.com/aalto-speech/FinChat

Latest versions/subcorpora:  
Finnish conversational chat corpus, source
icon-info-circle Metadata and license
icon-quote-right Attribution instructions
Download the resource
Search for all versions of this resource in META-SHARE  

Of this language corpus different versions/subcorpora are (or will be) published in the Language Bank of Finland. The versions are available through the Language Bank Download Service and/or through the Korp concordance tool. The links to the different versions can be found from the list above.

Detailed information on the content of each version, user rights and licenses can be found from it’s specific metadata record in META-SHARE.

This resource group page has a Persistent Identifier: http://urn.fi/urn:nbn:fi:lb-2022060901

Suomi 24 resource group

Suomeksi


Currently available versions of this resource

ShortnameName and metadataLicenseLocationCiteResource group and helpApplyPublication yearSupport level
ShortnameName and metadataLicenseLocationCiteResource group and helpApplyPublication yearSupport level

Upcoming versions of this resource

These resource versions are not yet available in the Language Bank of Finland.

ShortnameName and metadataLicenseFormatsSupport levelContact PersonResource group and helpLocationOther information
ShortnameName and metadataLicenseFormatsSupport levelContact PersonResource group and helpLocationOther information

 

Resource information

The resource consists of the discussions posted on the Suomi 24 discussion forum. The content was parsed and annotated with automatic methods.

Further details of each version of the resource are maintained in the metadata record, findable via the persistent identifier (see the link at the resource title).

License and access

  • Some versions of this resource are available publicly (PUB), whereas others require you to log in as an academic user (ACA). Click on the license icon to see the resource-specific license text.
  • Some/all versions of this resource may contain personal data (license condition +PRIV). The license may then include additional data protection terms and conditions that you must follow. If processing personal data, maintain a public Privacy Notice regarding your project and provide the link to the Language Bank of Finland, see instructions.
  • A copy of some versions of this resource may be readily available in the computing environment (see column ’Location’). icon-question-circle

Important notes

The Language Bank of Finland aims to publish new increments of the Suomi 24 resource at reasonable intervals. For example, the 2001-2020 versions include the previously published content from 2001-2017 and updated content from 2018-2020, and the next increment will add the years 2021-2023. Please note that at each update, some of the messages or threads may have been removed.

The next update (messages until the end of year 2023) is expected during spring 2025.

Additional instructions

Via the Korp service, it is possible to perform versatile search queries from the content and to obtain various statistics and visualizations (see Korp instructions).

Without logging in via Korp, you can see the items matching your search criteria as brief excerpts only. At each word token in the concordance, you can find a link to the original message and discussion thread on the original Suomi 24 discussion platform, in case they are still available there. If required, researchers can also log in in case they need to view the wider context around the matching items.

In addition to the corpus versions that are available in Korp, the corresponding full text documents are available for logged-in researchers in VRT format either on the CSC computing environment or as downloadable packages via the download service of Kielipankki (see the column ’Location’). In order to use the computing environment, researchers need a CSC user account. Please note, however, that in order to use the full text data efficiently, some technical and programming skills are usually required. The Korp service provides many opportunities for studying and analyzing the Suomi 24 corpus, so it is recommended that you first make sure whether Korp is suitable for your purpose.

 

 


This page has a persistent identifier: http://urn.fi/urn:nbn:fi:lb-2022011221

FinnSentiment

FinnSentiment is a Finnish social media corpus for sentiment polarity annotation. 27,000 sentence data set annotated independently with sentiment polarity by three native annotators. The corpus and its creation has been documented in https://arxiv.org/pdf/2012.02613.pdf.

Latest versions/subcorpora:  
FinnSentiment 1.1, source
icon-info-circle Metadata and license
icon-quote-right Attribution instructions
Download the resource
FinnSentiment, source
icon-info-circle Metadata and license
icon-quote-right Attribution instructions
Download the resource
Search for these versions in META-SHARE  

Of this language corpus different versions are (or might be in the future) published in the Language Bank of Finland. The versions are available through the Language Bank Download Service and/or through the Korp concordance tool. The links to the different versions can be found from the list above.

Detailed information on the content of each version, user rights and licenses can be found from it’s specific metadata record in META-SHARE.

This resource group page has a Persistent Identifier: http://urn.fi/urn:nbn:fi:lb-2021081106

Corpus of Global Web-Based English

The Corpus of Global Web-Based English (GloWbE) contains about 1.8 billion words and 1 800 000 texts from web pages in the United States, Great Britain, Australia, India, and 16 other countries. About 60 % of the texts come from blogs.

For general terms and conditions for this and other corpora from BYU please see https://www.corpusdata.org/restrictions.asp

More information on the BYU corpora at Kielipankki

Latest versions/subcorpora:
Corpus of Global Web-Based English – Kielipankki Korp version 2017H1
icon-info-circle Metadata and license
icon-quote-right Attribution instructions
Select the corpus in Korp
Corpus of Global Web-Based English – Kielipankki download version 2017H1
icon-info-circle Metadata and license
icon-quote-right Attribution instructions
Download the resource
Search for all versions in META-SHARE

Of this language corpus different versions/subcorpora are (or might be in the future) published in the Language Bank of Finland. The versions are available through the Language Bank Download Service and/or through the Korp concordance tool. The links to the different versions can be found from the list above.

Detailed information on the content of each version, user rights and licenses can be found from it’s specific metadata record in META-SHARE.

This resource group page has a Persistent Identifier: http://urn.fi/urn:nbn:fi:lb-2017061927

SFNET Corpus

The corpus contains written discussion in the SFNET Internet discussion forum in Finnish from 2002-2003.

Latest versions/subcorpora:  
SFNET Corpus
icon-info-circle Metadata and license
icon-quote-right Attribution instructions
Download the resource
A copy of this version is available in the computing environment. icon-question-circle
SFNET Corpus, Helsinki Korp Version
icon-info-circle Metadata and license
icon-quote-right Attribution instructions
Resource will be available soon
Search for all versions in META-SHARE  

Of this language corpus different versions/subcorpora are (or might be in the future) published in the Language Bank of Finland. The versions are available through the Language Bank Download Service and/or through the Korp concordance tool. The links to the different versions can be found from the list above.

Detailed information on the content of each version, user rights and licenses can be found from it’s specific metadata record in META-SHARE.

This resource group page has a Persistent Identifier: http://urn.fi/urn:nbn:fi:lb-2021052501

The HS.fi News and Comments Corpus

The HS.fi News and Comments Corpus contains the domestic news of the Helsingin Sanomat website and their comments from 5.9.2011 to 4.9.2012. The corpus starts with the first news of 5.9.2011 and ends with a news published in the morning on 3.9.2012 and the comments published on the website by 5.9.2012.

Latest versions/subcorpora:
The HS.fi News and Comments Corpus
icon-info-circle Metadata and license
icon-quote-right Attribution instructions
Select the corpus in Korp
Search for all versions in META-SHARE

Of this language corpus different versions/subcorpora are (or might be in the future) published in the Language Bank of Finland. The versions are available through the Language Bank Download Service and/or through the Korp concordance tool. The links to the different versions can be found from the list above.

Detailed information on the content of each version, user rights and licenses can be found from it’s specific metadata record in META-SHARE.

This resource group page has a Persistent Identifier: http://urn.fi/urn:nbn:fi:lb-2021051910

Ylilauta Corpus

The corpus contains text from discussions of the Ylilauta online discussion board from 2012 to 2014. Short fragments from the discussions, e.g. sentences or paragraphs, are publicly available in Kielipankki – the Language Bank of Finland.

Latest versions/subcorpora:  
Ylilauta Corpus
icon-info-circle Metadata and license
icon-quote-right Attribution instructions
Select the corpus in Korp
The Downloadable Version of the Ylilauta Corpus
icon-info-circle Metadata and license
icon-quote-right Attribution instructions
Download the resource
A copy of this version is available in the computing environment. icon-question-circle
Search for these versions in META-SHARE  

Of this language corpus different versions/subcorpora are published in the Language Bank of Finland. The versions are available through the Language Bank Download Service and/or through the Korp concordance tool. The links to the different versions can be found from the list above.

Detailed information on the content of each version, user rights and licenses can be found from it’s specific metadata record in META-SHARE.

This resource group page has a Persistent Identifier: http://urn.fi/urn:nbn:fi:lb-2021042602

Suomi 24 -aineistoryhmä

In English


Saatavilla olevat versiot

LyhenneNimi ja kuvailutiedotLisenssiSijaintiViiteAineistoryhmä ja ohjeHae käyttöoikeuttaJulkaisuvuosiTukitaso
LyhenneNimi ja kuvailutiedotLisenssiSijaintiViiteAineistoryhmä ja ohjeHae käyttöoikeuttaJulkaisuvuosiTukitaso

Tulossa olevat versiot

Nämä aineistoversiot eivät vielä ole saatavilla Kielipankin kautta.

LyhenneNimi ja kuvailutiedotLisenssiMuotoTukitasoContact PersonSijaintiAineistoryhmä ja ohjeMuu tieto
LyhenneNimi ja kuvailutiedotLisenssiMuotoTukitasoContact PersonSijaintiAineistoryhmä ja ohjeMuu tieto

Tietoa aineistosta

Aineisto koostuu Suomi 24 -foorumilta kerätyistä keskusteluista. Sisältö on jäsennetty automaattisin menetelmin.

Kunkin aineistoversion tarkemmat tiedot päivitetään kuvailutietueeseen, joka löytyy pysyvällä tunnisteella (ks. linkki aineiston otsikon kohdalla).

Lisenssit ja pääsy aineistoihin

  • Jotkin tämän aineiston versiot ovat saatavilla julkisesti (PUB), kun taas toisiin täytyy kirjautua akateemisena käyttäjänä (ACA). Lisenssikuvaketta napauttamalla näet tarkan aineistokohtaisen lisenssin.
  • Tämän aineiston versioihin voi sisältyä henkilötietoja (lisenssissä on merkintä +PRIV). Lisenssiin voi silloin sisältyä myös aineistokohtaisia tietosuojaehtoja, joita sinun on noudatettava. Jos käsittelet henkilötietoja, ylläpidä projektiasi koskevaa julkista tietosuojailmoitusta ja toimita sen linkki Kielipankille, ks. ohjeet.
  • Joidenkin tämän aineiston versioiden kopio voi olla saatavilla myös suoraan laskentaympäristössä (ks. Sijainti-sarake).

Huomautuksia

Kielipankki pyrkii kartuttamaan Suomi 24 -aineistoa sopivin väliajoin. Esimerkiksi vuosien 2001-2020 aineistoversiot sisältävät aiemmin julkaistut sisällöt vuosilta 2001-2017 ja päivitetyn aineiston 2018-2020, ja seuraavaan päivitykseen lisätään vuodet 2021-2023. Huomaa kuitenkin, että päivitysten yhteydessä osa viesteistä tai viestiketjuista on saatettu poistaa.

Seuraava aineistopäivitys (viestit vuoden 2023 loppuun saakka) on odotettavissa keväällä 2025.

Ohjeita

Korpin kautta tarjottavasta Suomi 24 -korpuksesta voi tehdä monipuolisia hakuja ja tilastoida tai kuvantaa hakutuloksia eri tavoin (katso Korp-palvelun ohjeet).

Kirjautumattomille käyttäjille aineiston tekstisisällöstä löytyneet hakuosumat näytetään Korpissa lyhyinä otteina. Hakuosumien kohdalta on linkit alkuperäiseen viestiin ja keskusteluketjuun Suomi 24 -palvelimella, mikäli nämä ovat edelleen olemassa. Tarvittaessa tutkija saa näkyviin myös laajemman kontekstin kirjautumalla Korp-palveluun.

Korp-palvelussa näkyvän korpusversion lisäksi vastaava VRT-muotoinen kokotekstiaineisto on kirjautuneiden tutkijoiden käytettävissä CSC:n laskentaympäristössä tai ladattavissa omalle koneelle Kielipankin latauspalvelusta (ks. Sijainti-sarake). Laskentaympäristön käyttäminen edellyttää CSC:n myöntämää käyttäjätunnusta. Huomaa, että kokotekstiaineiston hallintaan ja tehokkaaseen käsittelyyn tarvitaan yleensä jonkin verran teknistä osaamista ja ohjelmointitaitoja. Korp-palvelu tarjoaa monia mahdollisuuksia myös Suomi 24 -aineiston tutkimiseen, joten kannattaa ensin varmistaa, sopiiko se omaan tarkoitukseesi.

 

 


Tämän sivun PID: http://urn.fi/urn:nbn:fi:lb-2017021630

Search the Language Bank Portal:
Sofoklis Kakouros
Researcher of the Month: Sofoklis Kakouros

 

Upcoming events


Contact

The Language Bank's technical support:
kielipankki (at) csc.fi
tel. +358 9 4572001

Requests related to language resources:
fin-clarin (at) helsinki.fi
tel. +358 29 4129317

More contact information