How to calculate the relavent error rate in diarization overlap?

[axuan731]

I have a ref rttm file and a sys rttm file, I want to compute the FA = false alarm rate (%) / Miss. = missed detection rate (%) / F1 = F1-score (%) in the paper "End-to-end speaker segmentation for overlap-aware resegmentation".But I cant find the place to evaluate them in pyannote2.0
Thanks for helping!

[hbredin]

pyannote-metrics has some code to do that.

pyannote-metrics/pyannote/metrics/cli.py

Lines 137 to 159 in 2733ef5

	def to_overlap(current_file: dict) -> Annotation:
	"""Get overlapped speech reference annotation
	Parameters
	----------
	current_file : `dict`
	File yielded by pyannote.database protocols.
	Returns
	-------
	overlap : `pyannote.core.Annotation`
	Overlapped speech reference.
	"""
	reference = current_file["annotation"]
	overlap = Timeline(uri=reference.uri)
	for (s1, t1), (s2, t2) in reference.co_iter(reference):
	l1 = reference[s1, t1]
	l2 = reference[s2, t2]
	if l1 == l2:
	continue
	overlap.add(s1 & s2)
	return overlap.support().to_annotation()

http://pyannote.github.io/pyannote-metrics/reference.html#pyannote.metrics.detection.DetectionPrecisionRecallFMeasure