2013年TAC KBP评测总结

一.评测内容简介

KBP评测的目标是促进自动化系统的研究,包括在大语料库中发现命名实体信息,以及将这些信息整合到知识库中。TAC 2012的任务有三块,均旨在提高从文本中自动填充知识库的能力

2013年KBP评测包含三个子任务:EL(Entity Linking),SF(Slot Filling)和SSF(Sentiment Slot Filling),我们PRIS实验室今年参加了KBP所有的评测。

评测报告:PRIS2013.notebook

二.参加人员介绍

我们实验室的参加人员主要有:

指导老师:徐蔚然

指导博士:李岩(讨论会召集人),张春云

Enity Linking任务:左乃彻,王建龙

Slot Filling任务:张一昌,王颖

Sentiment Slot Filling任务:童欣,李东豫

主要完成人员的照片在后面

参加KBP评测的所有参赛的组织机构和该机构所参加的评测任务见附表

三.官方链接

http://www.nist.gov/tac/2013/KBP/

四.PRIS团队参赛情况

4.1 Enity Linking

【任务简介】

Entity-Linking: 给定一个query包含一个名字字符串(人名,地名,组织机构名),一个背景文档ID,一组标识字符串起始位置的UTF-8码,系统需要输出相应名字指示的KB entry(维基百科页面)的ID号,如果没有,输出一个”NILxxxx” ID。

【评测结果】

el

【参加人员:左乃彻、王建龙】

彻彻 王建龙

4.2 Slot Filling

【任务简介】

给定一个命名实体、一个预定义的属性集,通过抓取相关值的信息,扩充一个KB节点的属性值。KB的参考文献来自英文维基。Slot Filler Validation这个诊断任务,将去判断参赛者的系统是否正确完成了填充。

【评测结果】

SF

【参加人员:王颖、张一昌】

wy zyc

4.3 Sentiment Slot Filling

【任务简介】

Sentiment Slot Filling  是一个情感要素抽取的任务。做为信息抽取的一个子问题,情感要素抽取着重在于在大规模的语料集合中,找出query所给出的主体(holder)所对应的受体(target),或反之。比如,在语料集中找出不喜欢Obama的所有命名实体。或反之,找出文档集中所有Obama有积极评价的实体。其中,实体仅仅包括 人名,地名和组织机构名三类。以上的任务也可以描述如下:

情感的三元对:

{主体,情感倾向,受体}

三者中,给出两者(必须要有情感倾向),然后在语料集合中找出其它一个。

【评测结果】

ssf

【参加人员:童欣、李东豫】

童欣 李东豫

附:参加KBP评测的所有组织机构和该机构所参加的相关任务

ARPANI: Bhilai Institute of Technology, Durg: English Slot Filling

basistech: Basis Technology: Chinese Entity Linking, English Entity Linking, Spanish Entity Linking

BIT: Beijing Institute of Technology: English Slot Filling, Slot Filler Validation

Brandeis: Brandeis University: English Entity Linking

BUPTTeam: Beijing University of Posts and Communications: English Entity Linking

CASIA: Institute of Automation, Chinese Academy of Sciences: English Entity Linking

CMUML: Carnegie Mellon University: English Slot Filling, Temporal Slot Filling

CohenCMU: Carnegie Mellon University: English Slot Filling

columbia_nlp: Columbia University: Sentiment Slot Filling

Compreno: ABBYY: English Slot Filling, Temporal Slot Filling

cornpittmich: Cornell University / University of Pittsburgh: Sentiment Slot Filling

FRDC: Fujitsu R&D Center Co.,LTD.: Chinese Entity Linking

HITS: Heidelberg Institute for Theoretical Studies gGmbH: Chinese Entity Linking, English Entity Linking, Spanish Entity Linking

hltcoe: Johns Hopkins University Human Language Technology Center of Excellence: Cold Start KBP, English Entity Linking

IIRG: University College Dublin: English Slot Filling

INESCID: Instituto Superior Tecnico, INESC-ID: English Entity Linking, Spanish Entity Linking

jhuapl: Johns Hopkins University Applied Physics Laboratory: Slot Filler Validation

lkd: University of Economics, Prague: English Entity Linking

lsv: Saarland University: English Slot Filling

MS_MLI: Microsoft Research: English Entity Linking, Temporal Slot Filling

MSRA_Link: Microsoft Research Asia: English Entity Linking

NYU: New York University: Cold Start KBP, English Slot Filling

OSU: Oregon State University: English Entity Linking

polymtl: Ecole Polytechnique de Montreal: English Entity Linking

poseidon: Harbin Institute of Technology: English Entity Linking

PRIS2013: Beijing University of Posts and Telecommunications: English Entity Linking, English Slot Filling, Sentiment Slot Filling

RPI_BLENDER: Rensselaer Polytechic Institute: English Entity Linking, English Slot Filling, Slot Filler Validation, Temporal Slot Filling

SAFT_KRes: University of Southern California Information Sciences Institute: English Slot Filling

SINDI: Korea Institute of Science and Technology Information: English Slot Filling

Stanford: Stanford University: English Slot Filling, Slot Filler Validation

SYDNEY_CMCRC: University of Sydney / Capital Markets CMCRC: English Entity Linking

TALP_UPC: TALP Research Center of Technical University of Catalonia (UPC): English Entity Linking, English Slot Filling

THUNLP: Tsinghua University: Chinese Entity Linking, English Entity Linking

TRRD: Thomson Reuters R&D: English Entity Linking

UBC: University of Basque Country: English Entity Linking

UGENT_IBCN: Ghent University – IBCN / iMinds: English Entity Linking

UI_CCG: University of Illinois at Urbana Champaign: English Entity Linking, Slot Filler Validation

UMass_CIIR: CIIR, School of Computer Science, Univ. of Massachusetts Amherst: English Entity Linking

UMass_IESL: University of Massachusetts Amherst, Information Extraction and Synthesis Lab: Cold Start KBP, English Slot Filling

UNED: Universidad Nacional de Educacion a Distancia: English Slot Filling, Temporal Slot Filling

USFD: University of Sheffield: English Entity Linking

utaustin: University of Texas at Austin – AI Lab: English Slot Filling

UWashington: University of Washington: English Entity Linking, English Slot Filling

WebSail: Northwestern University: English Entity Linking

ZZ_INFO_TECH: Zhengzhou Information Science and Technology Institute: English Entity Linking

wedding dresses online,christian louboutin sale,ralph lauren italia,louis vuitton uk,michael kors bags

发表评论

电子邮件地址不会被公开。 必填项已用*标注