Best Python code snippet using yandex-tank
conll2eval_nested.py
Source:conll2eval_nested.py
1#!/usr/bin/env python32# coding=utf-83#4# Copyright 2019 Institute of Formal and Applied Linguistics, Faculty of5# Mathematics and Physics, Charles University, Czech Republic.6#7# This Source Code Form is subject to the terms of the Mozilla Public8# License, v. 2.0. If a copy of the MPL was not distributed with this9# file, You can obtain one at http://mozilla.org/MPL/2.0/.10"""Creates an evaluation file with named entities.11Input: CoNLL file with linearized (encoded) nested named entity labels12delimited with |.13Output: One entity mention per line, two columns per line separated by table.14First column are entity mentino token ids separated by comma, second column is15a BIO or BILOU label.16The output can be then evaluated with compare_nested_entities.py.17""" 18import sys19COL_SEP = "\t"20def raw(label):21 return label[2:]22def flush(running_ids, running_forms, running_labels):23 for i in range(len(running_ids)):24 print(running_ids[i] + COL_SEP + running_labels[i] + COL_SEP + running_forms[i])25 return ([], [], [])26if __name__ == "__main__":27 i = 028 running_ids = []29 running_forms = []30 running_labels = []31 for line in sys.stdin:32 line = line.rstrip("\r\n")33 if not line: # flush entities34 (running_ids, running_forms, running_labels) = flush(running_ids, running_forms, running_labels)35 else:36 form , _, _, ne = line.split("\t")37 if ne == "O": # flush entities38 (running_ids, running_forms, running_labels) = flush(running_ids, running_forms, running_labels)39 else:40 labels = ne.split("|")41 for j in range(len(labels)): # for each label42 label = labels[j]43 if j < len(running_ids): # running entity44 # previous running entity ends here, print and insert new entity instead45 if label.startswith("B-") or label.startswith("U-") or running_labels[j] != raw(label):46 print(running_ids[j] + COL_SEP + running_labels[j] + COL_SEP + running_forms[j])47 running_ids[j] = str(i)48 running_forms[j] = form49 # entity continues, append ids and forms50 else:51 running_ids[j] += "," + str(i)52 running_forms[j] += " " + form53 running_labels[j] = raw(label)54 else: # no running entities, new entity starts here, just append55 running_ids.append(str(i))56 running_forms.append(form)57 running_labels.append(raw(label))58 ...
Learn to execute automation testing from scratch with LambdaTest Learning Hub. Right from setting up the prerequisites to run your first automation test, to following best practices and diving deeper into advanced test scenarios. LambdaTest Learning Hubs compile a list of step-by-step guides to help you be proficient with different test automation frameworks i.e. Selenium, Cypress, TestNG etc.
You could also refer to video tutorials over LambdaTest YouTube channel to get step by step demonstration from industry experts.
Get 100 minutes of automation test minutes FREE!!