Fix typing and remove the `# type: ignore` comments

[tompollard]

In #153 we added pyright type checking to the github workflow. Currently we are dodging a large number of errors with # type: ignore comments. These need to be removed and the typing needs to be fixed.