To create a new bibliography file in Overleaf, in the editor, click New File icon.
An input box will appear for you to set the name of the new file. The file should have the .bib extension, in this example it's called "mybibliography.bib"; now click on Create.
A new file will be listed in the left panel, click it to edit its contents. Add your bibliography entries there.