Method:

The BIOSSES data set comprises total 100 sentence pairs all of which were selected from the "TAC2 Biomedical Summarization Track Training Data Set" .

You can download the data set and annotator scores from here: BIOSSES Data Set .

The sentence pairs were evaluated by five different human experts that judged their similarity and gave scores in a range [0-4]. Our guideline was prepared based on SemEval 2012 Task 6 Guideline.

Table below illustrates sample sentences with their corresponding similarity scores according to our guideline.

SENTENCE 1 SENTENCE 2 COMMENT SCORE
Here we show that both C/EBPα and NFI-A bind the region responsible for miR-223 upregulation upon RA treatment. Isoleucine could not interact with ligand fragment 44 (LF44),which contains amino group. The two sentences are on different topics. 0
Membrane proteins are proteins that interact with biological membranes. Previous studies have demonstrated that membrane proteins are implicated in many diseases because they are positioned at the apex of signaling pathways that regulate cellular processes. The two sentences are not equivalent, but are on the same topic. 1
This article discusses the current data on using anti HER2 therapies to treat CNS metastasis as well as the newer anti-HER2 agents. Breast cancers with HER2 amplification have a higher risk of CNS metastasis and poorer prognosis. The two sentences are not equivalent, but share some details. 2
We were able to confirm that the cancer tissues had reduced expression of miR-126 and miR-424,and increased expression of miR-15b, miR-16,miR-146a, miR-155, and miR-223. A recent study showed that the expression of miR-126 and miR424 had reduced by the cancer tissues. The two sentences are roughly equivalent, but some important information differs/missing. 3
Hydrolysis of β-lactam antibiotics by β-lactamases is the most common mechanism of resistance for this class of antibacterial agents in clinically important Gram-negative bacteria. In Gram-negative organisms, the most common β-lactam resistance mechanism involves β-lactamase mediated hydrolysis resulting in subsequent inactivation of the antibiotic. The two sentences are completely or mostly equivalent, as they mean the same thing. 4