To date, many machine learning models have been used for peach maturity prediction using non-destructive data, but no performance comparison of the models on these datasets has been conducted. In ...this study, eight machine learning models were trained on a dataset containing data from 180 ‘Suncrest’ peaches. Before the models were trained, the dataset was subjected to dimensionality reduction using the least absolute shrinkage and selection operator (LASSO) regularization, and 8 input variables (out of 29) were chosen. At the same time, a subgroup consisting of the peach ground color measurements was singled out by dividing the set of variables into three subgroups and by using group LASSO regularization. This type of variable subgroup selection provided valuable information on the contribution of specific groups of peach traits to the maturity prediction. The area under the receiver operating characteristic curve (AUC) values of the selected models were compared, and the artificial neural network (ANN) model achieved the best performance, with an average AUC of 0.782. The second-best machine learning model was linear discriminant analysis with an AUC of 0.766, followed by logistic regression, gradient boosting machine, random forest, support vector machines, a classification and regression trees model, and k-nearest neighbors. Although the primary parameter used to determine the performance of the model was AUC, accuracy, F1 score, and kappa served as control parameters and ultimately confirmed the obtained results. By outperforming other models, ANN proved to be the most accurate model for peach maturity prediction on the given dataset.
This study compares the effectiveness of fine-tuning Transformer models, specifically BERT, RoBERTa, DeBERTa, and GPT-2, against using prompt engineering in LLMs like ChatGPT and GPT-4 for ...multi-class classification of hotel reviews. As the hospitality industry increasingly relies on online customer feedback to improve services and strategize marketing, accurately analyzing this feedback is crucial. Our research employs a multi-task learning framework to simultaneously conduct sentiment analysis and categorize reviews into aspects such as service quality, ambiance, and food. We assess the capabilities of fine-tuned Transformer models and LLMs with prompt engineering in processing and understanding the complex user-generated content prevalent in the hospitality industry. The results show that fine-tuned models, particularly RoBERTa, are more adept at classification tasks due to their deep contextual processing abilities and faster execution times. In contrast, while ChatGPT and GPT-4 excel in sentiment analysis by better capturing the nuances of human emotions, they require more computational power and longer processing times. Our findings support the hypothesis that fine-tuning models can achieve better results and faster execution than using prompt engineering in LLMs for multi-class classification in hospitality reviews. This study suggests that selecting the appropriate NLP model depends on the task’s specific needs, balancing computational efficiency and the depth of sentiment analysis required for actionable insights in hospitality management.
This paper deals with the analysis of data retrieved from a web page for booking accommodation. The main idea of the research is to analyze the relationship between accommodation factors and customer ...reviews in order to determine the factors that have the greatest influence on customer reviews. Machine learning methods are applied to the collected data and models that can predict the review category for those accommodations that are not evaluated by users are trained. The relationship between certain accommodation factors and classification accuracy of the models is examined in order to get detailed insight into the data used for model training, as well as to make the models more interpretable. The classification accuracy of each model is tested and the precision and recall of the models are examined and compared.
Collocations have been the subject of much scientific research over the years. The focus of this research is on a subset of collocations, namely metaphorical collocations. In metaphorical ...collocations, a semantic shift has taken place in one of the components, i.e., one of the components takes on a transferred meaning. The main goal of this paper is to review the existing literature and provide a systematic overview of the existing research on collocation extraction, as well as the overview of existing methods, measures, and resources. The existing research is classified according to the approach (statistical, hybrid, and distributional semantics) and presented in three separate sections. The insights gained from existing research serve as a first step in exploring the possibility of developing a method for automatic extraction of metaphorical collocations. The methods, tools, and resources that may prove useful for future work are highlighted.
Kolokacije su već dugi niz godina tema mnogih znanstvenih istraživanja. U fokusu ovoga istraživanja podskupina je kolokacija koju čine metaforičke kolokacije. Kod metaforičkih je kolokacija kod jedne od sastavnica došlo do semantičkoga pomaka, tj. jedna od sastavnica poprima preneseno značenje. Glavni su ciljevi ovoga rada istražiti postojeću literaturu te dati sustavan pregled postojećih istraživanja na temu izlučivanja kolokacija i postojećih metoda, mjera i resursa. Postojeća istraživanja opisana su i klasificirana prema različitim pristupima (statistički, hibridni i zasnovani na distribucijskoj semantici). Također su opisane različite asocijativne mjere i postojeći načini procjene rezultata automatskoga izlučivanja kolokacija. Metode, alati i resursi koji su korišteni u prethodnim istraživanjima, a mogli bi biti korisni za naš budući rad posebno su istaknuti. Stečeni uvidi u postojeća istraživanja čine prvi korak u razmatranju mogućnosti razvijanja postupka za automatsko izlučivanje metaforičkih kolokacija.
Službena dvojezičnost u Istarskoj županiji Lalli Paćelat, Ivana; Brkić Bakarić, Marija; Matticchio, Isabella
Rasprave Instituta za hrvatski jezik i jezikoslovlje,
2020, Letnik:
46, Številka:
2
Journal Article, Web Resource
Recenzirano
Odprti dostop
Službena dvojezičnost pretpostavlja svakodnevno stvaranje usporednih tekstova u dvojezičnim područjima. Slučaj je takav i u Istarskoj županiji, u kojoj se tekstovi obično sastavljaju na hrvatskome, a ...zatim se prevode na talijanski jezik. zbog činjenice da je riječ o službenim tekstovima i zbog konteksta uporabe talijanskoga jezika vrlo je važno imati precizno i ujednačeno nazivlje te razvijene jezične tehnologije koje bi omogućile brže i kvalitetnije prevođenje u dvojezičnim institucijama u Istarskoj županiji. Ciljevi su ovoga rada: (1) prikazati ostvarivanje ravnopravne službene uporabe talijanskoga kao manjinskoga jezika u Istarskoj županiji (1a) analizom prevedenih sadržaja na službenim mrežnim stranicama službeno dvojezičnih gradova i općina i (1b) prikazom dosadašnje prakse prevođenja te (2) ukazati na važnost i nužnost razvoja jezičnih tehnologija (2a) prikazom trendova u razvoju jezičnih tehnologija u sličnim dvojezičnim i višejezičnim institucijama, (2b) prikazom pripreme usporednoga korpusa administrativnih tekstova Istarske županije i (2c) analizom postojećega nazivlja provedenom na priređenome korpusu.
Rezultati analize dostupnosti dvojezičnih sadržaja na mrežnim stranicama te analize nazivlja provedene na usporednome korpusu pokazali su da je nužno razviti i upotrebljavati prevoditeljske alate i jezične izvore prilagođene talijanskomu kao manjinskomu jeziku kako bi se olakšalo i ubrzalo prevođenje, a time i omogućilo uspješnije ostvarivanje ravnopravne uporabe talijanskoga kao manjinskoga jezika.
Official bilingualism assumes the daily creation of parallel texts in bilingual areas. this is also the case in Istria County, where texts are usually written in Croatian and then translated into Italian. Given the official nature of texts and the context of the Italian language usage, it is extremely important to have a precise and uniform terminology, as well as well-developed language technologies, which would allow a faster and more accurate translation processes in bilingual institutions of Croatia. the aims of this paper are (1) to investigate the equal use of both Croatian and Italian as a minority language in the Istrian County through (1a) an analysis of the translated content on the official websites of the officially bilingual cities and municipalities and through (1b) an overview of current translation practices, and (2) to highlight the importance and necessity of the development of language technology through (2a) the presentation of trends in the development of language technology in similar bilingual and multilingual institutions, (2b) the presentation of the parallel corpus compiled from administrative texts of the Istrian County and (2c) the analysis of existing terminology conducted on the compiled corpus. the analysis of the availability of bilingual content on websites and the terminology extracted from the compiled parallel corpus indicates the need to develop and use translation tools and linguistic resources tailored to the Italian language as a minority language, in order to facilitate and accelerate the translation activity, thus allowing a more efficient use of Italian as a minority language.
Translation error analysis in Treat Majcunić, Suzana; Matetić, Maja; Brkić Bakarić, Marija
Zbornik Veleučilišta u Rijeci,
05/2019, Letnik:
7, Številka:
1
Journal Article
Recenzirano
Odprti dostop
The aim of this research paper is to conduct a thorough analysis of inter-annotator agreement in the process of error analysis, which is well-known for its subjectivity and low level of agreement. ...Since the process is tiresome in its nature and the available user interfaces are pretty distinct from what the average annotator is accustomed to, a user-friendly Windows 10 application offering a more attractive user interface is developed with the aim to simplify the process of error analysis. Translations are performed with Google Translate engine and English-Croatian is selected as the language pair. Since there has been a
lot of dispute on inter-annotator agreement and the need for guidelines
has been often been emphasized as crucial, the annotators are given a very detailed introduction into the process of error analysis itself. They are given a presentation with a list of the MQM guidelines enriched
with tricky cases. All annotators are native speakers of Croatian as the target language and have a linguistic background. The results demonstrate that a stronger agreement indicates more similar backgrounds
and that the task of selecting annotators should be conducted more carefully. Furthermore, a training phase on a similar test set is deemed
necessary in order to gain a stronger agreement.
Cilj rada je izvršiti temeljitu analizu slaganja među označivačima u postupku analize pogrešaka koji je poznat po svojoj subjektivnosti i niskoj razini slaganja. Budući da je sam postupak po prirodi zamoran, a sučelja dostupnih alata i usluga poprilično se razlikuju od onog na što je prosječni označivač naviknut, u svrhu pojednostavljenja samog postupka analize pogrešaka razvijena je Windows 10 aplikacija s poznatim
i atraktivnim korisničkim sučeljem. Englesko-hrvatski prijevodi preuzeti su s usluge Google Translate. Budući da je slaganje među označivačima čest predmet rasprave i da je od neospornog značaja istaknuta potreba za smjernicama, označivačima je dan vrlo detaljan uvid
u postupak analize pogrešaka. Također, popis MQM smjernica uz primjere potencijalnih pogrešaka uobličen je u prezentaciju i dan označivačima na
raspolaganje. Označivačima je ciljni, tj. hrvatski jezik materinski, a svi imaju određenu razinu lingvističke pozadine. Rezultati otkrivaju da veća razina slaganja ukazuje na sličnije formalno obrazovanje i da proces odabira označivača treba biti pažljivo osmišljen. Štoviše, testiranje na sličnom skupu podataka trebalo bi prethoditi odabiru označivača kako bi se postigla veća razina slaganja.
Peaches (Prunus persica (L.) Batsch) are a popular fruit in Europe and Croatia. Maturity at harvest has a crucial influence on peach fruit quality, storage life, and consequently consumer acceptance. ...The main goal of this study is to develop a machine learning model that will detect the most important features for predicting peach maturity by first training models and then using the importance ratings of these models to detect nonlinear (and linear) relationships. Thus, the most important peach features at a given stage of its ripening could be revealed. To date, this method has not been used for this purpose, and at the same time, it has the potential to be applied to other similar peach varieties. A total of 33 fruit features are measured on the harvested peaches, and three imbalanced datasets are created using firmness thresholds of 1.84, 3.57, and 4.59 kg·cm−2. These datasets are balanced using the SMOTE and ROSE techniques, and the Random Forest machine learning model is trained on them. Permutation Feature Importance (PFI), Variable Importance (VI), and LIME interpretability methods are used to detect variables that most influence predictions in the given machine learning models. PFI shows that the h° and a* ground color parameters, COL ground color index, SSC/TA, and TA inner quality parameters are among the top ten most contributing variables in all three models. Meanwhile, VI shows that this is the case for the a* ground color parameter, COL and CCL ground color indexes, and the SSC/TA inner quality parameter. The fruit flesh ratio is highly positioned (among the top three according to PFI) in two models, but it is not even among the top ten in the third.
Predicting fruit ripeness allows us to choose the optimal time to harvest. The parameter by which peach ripeness is commonly represented is its firmness. As traditional methods for determining ...firmness of peaches are destructive, this paper uses an alternative method for determining peach ripeness which is based on peach impedance, as recommended by the domain expert. The data set on which the data analysis is performed contains measurements obtained from a couple of hundred fruit measurements, which also include peach impedance. In our data analysis, we use one of the high accuracy machine learning models, which are called black box models and which are characterized by low interpretability. The paper presents the results of applying a black box type machine learning method, as well as methods for interpreting black box models which facilitate understanding of the model behavior for domain experts, i.e. Variable importance, Tree Surrogate, Local Interpretable Model-Agnostic Explanations and Break Down. Keywords: interpretability; explainable machine learning; predicting fruit ripeness; peach impedance
One of the main drawbacks of delivering new teaching lessons in e-learning systems is the lack of motivation for using those systems. This paper analyses which elements of computer games for learning ...mathematics have a beneficial effect on intrinsic motivation and give students continuous feedback in order to improve the learning process. While the control group has access to the basic version of the educational computer game, the experimental group uses the version enriched with additional motivational elements which include enhanced graphics for indulging in the game, messages of support while playing the game, and the possibility to compare results with fellow peers in terms of trophies and medals won.
Ljudsko djelovanje u 21. stoljeću, pod utjecajem je 4. industrijske revolucije koja na dnevnoj bazi mijenja način na koji društvo živi, napreduje i egzistira. Neočekivanom pojavom pandemije, kao ...pozitivan odgovor, uslijedila su brojna digitalna rješenja koja su potaknula još veći razvoj i promet, kako web tako i mobilnih aplikacija te ostalih digitalnih rješenja. Glavni cilj ovog rada je istražiti postupke digitalizacije, digitalnih rješenja, tehnologija i aplikacija koje su se koristile tijekom pandemije te ukazati na napredak digitalnih rješenja razvijenih u novim, nepoznatim okolnostima kao i identificirati moguće izazove u njihovom daljnjem razvoju i primjeni te predložiti moguća rješenja. U radu se opisuje uloga tehnologije u olakšavanju svakodnevnih aktivnosti u izvanrednim okolnostima te se identificiraju prednosti i mogući izazovi u primjeni digitalnih rješenja u takvim okolnostima. U tu se svrhu opisuju najutjecajnije web aplikacije i digitalne tehnologije te njihova uloga u osiguranju normalnog tijeka života u izazovnim vremenima.
Human activity in the 21st century is under the influence of the fourth industrial revolution, which is changing the way society lives, develops and exists on a daily basis. The unexpected appearance of the pandemic as a positive reaction was followed by numerous digital solutions that stimulated even greater development and traffic, both web and mobile applications and other digital solutions. The main objective of this paper is to examine digitalization processes, digital solutions, technologies and applications used during the pandemic and to show the progress of digital solutions developed under new, unknown circumstances, as well as to identify possible challenges in their further development and application and to propose possible solutions. The paper describes the role of technology in facilitating everyday activities in exceptional circumstances and highlights the benefits and potential challenges of applying digital solutions in such circumstances. It describes the most influential web applications and digital technologies and their role in ensuring the normal course of life in difficult times.
PDF
