TASS 2017: Result submission site

This is the web page for submitting the results of the systems of the participants of the edition of 2017. The web page will accept submissions after the evaluation deadline, so the results shown in this web page are not the official ones of the shared task. Only those result files subbmited before the evaluation deadline (4th of July) will be taken into account in the shared task. The official results will be published in this web page.

Task 1: Sentiment Analysis at tweet level

Test corpus: InterTASS

Group	Run Id	Date	Macro-P	Macro-R	Macro-F1	Accuracy
jacerong	run-1	2017-07-02 20:03:48	0.479	0.440	0.459	0.608
jacerong	run-2	2017-07-02 20:06:02	0.490	0.434	0.460	0.602
jacerong	run-3	2017-07-02 20:07:27	0.427	0.434	0.430	0.576
jacerongr	tass_2016-run_3	2017-07-02 20:35:57	0.000	0.000	0.000	0.000
GSI	sent64-189	2017-07-02 22:55:51	0.397	0.349	0.371	0.524
GSI	sent64-149-ant	2017-07-02 23:40:34	0.000	0.000	0.000	0.000
GSI	sent64-149-ant-2	2017-07-02 23:41:11	0.291	0.322	0.306	0.479
tecnolengua	run3	2017-07-03 01:07:03	0.437	0.445	0.441	0.576
tecnolengua	run2	2017-07-03 01:08:51	0.437	0.445	0.441	0.576
SINAI	w2v-nouser	2017-07-03 12:11:47	0.464	0.423	0.442	0.575
SINAI	w2v-user	2017-07-03 12:15:02	0.443	0.415	0.428	0.569
SINAI	embed-rnn	2017-07-03 12:18:27	0.248	0.056	0.091	0.063
SINAI	embed-rnn2	2017-07-03 12:32:38	0.339	0.328	0.333	0.391
SINAI	tfidf-rnn	2017-07-03 12:59:22	0.101	0.250	0.144	0.404
ELiRF-UPV	run1	2017-07-03 13:42:28	0.497	0.490	0.493	0.607
ELiRF-UPV	run2	2017-07-03 13:43:44	0.481	0.424	0.450	0.436
ELiRF-UPV	run3	2017-07-03 13:44:25	0.470	0.461	0.466	0.597
tecnolengua	run4	2017-07-03 13:56:22	0.416	0.422	0.419	0.568
tecnolengua	run5	2017-07-03 16:24:07	0.413	0.431	0.422	0.575
tecnolengua	final	2017-07-03 18:19:03	0.411	0.425	0.418	0.569
INGEOTEC	evodag_001	2017-07-03 20:49:50	0.459	0.455	0.457	0.507
INGEOTEC	evodag_002	2017-07-03 21:12:51	0.410	0.397	0.403	0.515
RETUYT	svm	2017-07-04 02:32:25	0.470	0.444	0.457	0.583
RETUYT	cnn	2017-07-04 03:07:57	0.446	0.421	0.433	0.513
ITAINNOVA	model1	2017-07-04 15:16:45	0.438	0.411	0.424	0.569
OEG	laOEG	2017-07-04 15:19:11	0.383	0.370	0.377	0.505
RETUYT	cnn2	2017-07-04 15:57:01	0.415	0.382	0.398	0.497
tecnolengua	sent_only	2017-07-04 16:13:26	0.453	0.459	0.456	0.582
OEG	pN3OEG	2017-07-04 16:36:56	0.382	0.365	0.373	0.460
OEG	pN3OEGv2	2017-07-04 16:42:43	0.345	0.366	0.355	0.462
OEG	pN3OEGv3	2017-07-04 16:46:37	0.187	0.312	0.234	0.262
OEG	victor0	2017-07-04 18:26:47	0.388	0.378	0.383	0.433
LexFAR	run1	2017-07-04 18:33:01	0.433	0.427	0.430	0.539
LexFAR	run2	2017-07-04 18:46:44	0.372	0.371	0.372	0.490
tecnolengua	no_handles	2017-07-04 20:26:01	0.416	0.413	0.414	0.571
tecnolengua	sent_only_fixed	2017-07-04 20:30:42	0.455	0.427	0.441	0.595
tecnolengua	sent_only_grules	2017-07-04 20:34:59	0.446	0.423	0.434	0.576
RETUYT	cnn3	2017-07-04 21:50:00	0.458	0.428	0.443	0.558
OEG	victor2	2017-07-04 21:50:14	0.400	0.389	0.395	0.451
LexFAR	run3	2017-07-04 21:58:34	0.433	0.431	0.432	0.541
RETUYT	cnn4	2017-07-04 22:29:45	0.433	0.440	0.437	0.579
OEG	laOEGv2	2017-07-04 22:57:59	0.367	0.360	0.364	0.452
RETUYT	svm_cnn	2017-07-04 23:02:40	0.490	0.453	0.471	0.596
OEG	pN3OEGv4	2017-07-04 23:12:21	0.370	0.361	0.365	0.452
ITAINNOVA	model3	2017-07-04 23:15:46	0.443	0.446	0.445	0.561
OEG	laOEGv3	2017-07-04 23:23:12	0.381	0.352	0.366	0.399
ITAINNOVA	model2	2017-07-05 09:01:49	0.450	0.423	0.436	0.576
GSI	LSTM-WE	2017-07-12 18:44:20	0.352	0.392	0.371	0.537
GSI	LSTM-WE-LEX	2017-07-13 13:52:23	0.376	0.400	0.387	0.562
ELiRF-UPV	f1	2017-10-05 19:51:23	0.501	0.485	0.493	0.590
ELiRF-UPV	macro-f1	2017-10-05 19:58:16	0.521	0.481	0.500	0.551
ELiRF-UPV	macro-f1-2	2017-10-06 00:50:19	0.508	0.484	0.496	0.597
ELiRF-UPV	macro-f1-3	2017-10-06 19:31:59	0.497	0.467	0.482	0.600
ELiRF-UPV	macro-f1-3-fix	2017-10-06 19:43:09	0.506	0.488	0.497	0.596
ELiRF-UPV	macro-f1-3-fix-2	2017-10-06 19:51:26	0.512	0.492	0.502	0.601
ELiRF-UPV	run-pk-fm	2017-10-10 21:13:15	0.499	0.487	0.493	0.589
ELiRF-UPV	bs256	2017-10-12 02:52:31	0.508	0.460	0.482	0.552
ELiRF-UPV	macro-f1-3-fix-2-bs-256	2017-10-12 02:56:50	0.507	0.471	0.489	0.612
ELiRF-UPV	macro-f1-3-copy	2017-10-12 03:00:59	0.504	0.478	0.491	0.599

Test corpus: General Corpus of TASS (3 levels, full test corpus)

Group	Run Id	Date	Macro-P	Macro-R	Macro-F1	Accuracy
tecnolengua	531F1_no_ngrams	2017-07-01 17:27:16	0.508	0.509	0.508	0.652
jacerong	tass_2016-run_3	2017-07-01 19:01:21	0.568	0.567	0.568	0.705
jacerong	run-1	2017-07-01 19:06:22	0.587	0.552	0.569	0.706
jacerong	run-2	2017-07-01 19:11:11	0.542	0.547	0.545	0.701
tecnolengua	general_1k_no_ngrams	2017-07-01 19:47:34	0.494	0.008	0.016	0.011
tecnolengua	run3	2017-07-03 01:33:23	0.527	0.529	0.528	0.657
ELiRF-UPV	run1	2017-07-03 13:47:16	0.539	0.546	0.542	0.666
ELiRF-UPV	run2	2017-07-03 13:51:45	0.539	0.560	0.549	0.659
ELiRF-UPV	run3	2017-07-03 13:54:58	0.541	0.556	0.548	0.725
GSI	run-1	2017-07-03 16:23:22	0.241	0.386	0.297	0.477
tecnolengua	final	2017-07-03 20:36:39	0.516	0.517	0.517	0.632
INGEOTEC	evodag_001	2017-07-03 21:01:10	0.463	0.432	0.447	0.514
tecnolengua	allfeats	2017-07-03 22:34:55	0.501	0.506	0.503	0.631
RETUYT	svm	2017-07-04 02:44:05	0.535	0.530	0.533	0.656
RETUYT	cnn	2017-07-04 03:42:15	0.534	0.548	0.541	0.638
OEG	laOEG	2017-07-04 15:26:02	0.350	0.342	0.346	0.407
RETUYT	cnn2	2017-07-04 16:16:36	0.545	0.513	0.529	0.650
INGEOTEC	evodag_002	2017-07-04 16:52:47	0.362	0.366	0.364	0.449
INGEOTEC	evodag_003	2017-07-04 19:29:35	0.559	0.595	0.577	0.645
RETUYT	cnn3	2017-07-04 22:23:18	0.542	0.536	0.539	0.654
RETUYT	cnn4	2017-07-04 22:48:04	0.534	0.527	0.531	0.665
GSI	64sent99ally	2017-07-04 23:20:13	0.302	0.348	0.324	0.434
RETUYT	svm_cnn	2017-07-04 23:22:05	0.555	0.537	0.546	0.674
OEG	victor2	2017-07-05 00:15:33	0.395	0.384	0.389	0.496
GSI	run1_we	2017-07-10 18:27:53	0.095	0.125	0.108	0.094
GSI	LSTM-WE	2017-07-12 18:40:23	0.526	0.493	0.509	0.631
GSI	LSTM-WE-LEX	2017-07-13 13:46:16	0.502	0.491	0.497	0.631
ELiRF-UPV	macro-f1	2017-10-08 18:35:02	0.517	0.516	0.517	0.633
ELiRF-UPV	f1	2017-10-08 19:02:10	0.508	0.487	0.498	0.564

Test corpus: General Corpus of TASS (3 levels, 1k corpus)

Group	Run Id	Date	Macro-P	Macro-R	Macro-F1	Accuracy
jacerong	run-1	2017-07-02 19:15:06	0.476	0.545	0.508	0.678
jacerong	run-2	2017-07-02 20:34:09	0.473	0.544	0.506	0.673
jacerong	tass_2016-run_3	2017-07-02 20:36:56	0.500	0.538	0.518	0.625
jacerongr	run-1	2017-07-02 20:52:26	0.476	0.545	0.508	0.678
tecnolengua	run3	2017-07-03 01:12:12	0.501	0.543	0.521	0.638
tecnolengua	run4	2017-07-03 13:52:52	0.466	0.502	0.483	0.612
ELiRF-UPV	run1	2017-07-03 14:00:16	0.496	0.544	0.519	0.630
ELiRF-UPV	run2	2017-07-03 14:00:49	0.480	0.530	0.504	0.596
ELiRF-UPV	run3	2017-07-03 14:01:23	0.442	0.518	0.477	0.588
GSI	run-1	2017-07-03 16:14:50	0.303	0.355	0.327	0.558
tecnolengua	final	2017-07-03 18:19:43	0.470	0.507	0.488	0.618
tecnolengua	no_handles	2017-07-03 19:50:05	0.462	0.512	0.486	0.593
tecnolengua	no_handles_kwneu	2017-07-03 20:04:53	0.450	0.495	0.471	0.576
tecnolengua	user	2017-07-03 20:54:50	0.434	0.475	0.454	0.583
INGEOTEC	evodag_002	2017-07-03 20:58:20	0.435	0.443	0.439	0.431
INGEOTEC	evodag_001	2017-07-03 21:19:16	0.387	0.390	0.388	0.486
tecnolengua	cleankw	2017-07-03 22:03:51	0.462	0.509	0.485	0.598
RETUYT	svm	2017-07-04 02:40:58	0.545	0.580	0.562	0.700
RETUYT	cnn	2017-07-04 03:11:40	0.511	0.550	0.529	0.648
OEG	laOEG	2017-07-04 15:23:02	0.348	0.345	0.346	0.448
RETUYT	cnn2	2017-07-04 15:48:18	0.563	0.547	0.555	0.694
tecnolengua	ng_kw	2017-07-04 17:07:45	0.456	0.505	0.479	0.599
tecnolengua	neunonekw	2017-07-04 17:17:46	0.446	0.491	0.467	0.573
INGEOTEC	evodag_003	2017-07-04 18:59:15	0.501	0.553	0.526	0.595
OEG	victor2	2017-07-04 21:58:49	0.361	0.370	0.366	0.412
RETUYT	cnn3	2017-07-04 22:00:55	0.528	0.562	0.545	0.697
RETUYT	cnn4	2017-07-04 22:32:17	0.542	0.572	0.557	0.694
GSI	64sent99ally	2017-07-04 22:43:45	0.337	0.306	0.321	0.499
RETUYT	svm_cnn	2017-07-04 23:22:56	0.505	0.578	0.539	0.711
OEG	victor3w	2017-07-05 00:17:08	0.277	0.315	0.295	0.484
OEG	victor3b	2017-07-05 07:20:51	0.402	0.337	0.367	0.386
GSI	LSTM-WE	2017-07-12 18:43:06	0.425	0.491	0.456	0.601
GSI	LSTM-WE-LEX	2017-07-13 13:50:39	0.446	0.492	0.468	0.636

Task 2: Aspect based Sentiment Analysis

Test corpus: Social-TV

Group	Run Id	Date	Macro-P	Macro-R	Macro-F1	Accuracy
ELiRF-UPV	run1	2017-07-03 16:18:58	0.473	0.479	0.476	0.625
ELiRF-UPV	run2	2017-07-03 16:19:16	0.523	0.505	0.513	0.600
ELiRF-UPV	run3	2017-07-03 16:19:43	0.529	0.546	0.537	0.615
RETUYT	svm	2017-07-04 18:13:41	0.419	0.406	0.413	0.493
RETUYT	svm2	2017-07-04 21:16:05	0.432	0.421	0.426	0.595

Test corpus: STOMPOL

Group	Run Id	Date	Macro-P	Macro-R	Macro-F1	Accuracy
ELiRF-UPV	run1	2017-07-03 16:12:07	0.534	0.541	0.537	0.615
ELiRF-UPV	run2	2017-07-03 16:13:55	0.492	0.481	0.486	0.541
ELiRF-UPV	run3	2017-07-03 16:14:16	0.482	0.490	0.486	0.578
C100T-PUCP	run1	2017-07-04 20:37:38	0.418	0.413	0.415	0.563
RETUYT	svm	2017-07-04 21:38:44	0.366	0.388	0.377	0.514
RETUYT	svm2	2017-07-04 21:48:29	0.516	0.501	0.508	0.590
C100T-PUCP	run3	2017-07-05 07:28:05	0.452	0.438	0.445	0.528
C100T-PUCP	run2	2017-07-08 07:28:48	0.344	0.399	0.369	0.495

---

---