New top story on Hacker News: Show HN: Cloning a musical instrument from 16 seconds of audio

Show HN: Cloning a musical instrument from 16 seconds of audio
19 by abdljasser2 | 1 comments on Hacker News.
In 2020, Magenta released DDSP [1], a machine learning algorithm / python library which made it possible to generate good sounding instrument synthesizers from about 6-10 minutes of data. While working with DDSP for a project, we realised how it was actually quite hard to find 6-10 minute of clean recordings of monophonic instruments. In this project, we have combined the DDSP architecture with a domain adaptation technique from speech synthesis [2]. This domain adaptation technique works by pre-training our model on many different recordings from the Solos dataset [3] first and then fine-tuning parts of the model to the new recording. This allows us to produce decent sounding instrument synthesisers from as little as 16 seconds of target audio instead of 6-10 minutes. [1] https://ift.tt/cdPY8O9 [2] https://ift.tt/xUdJoz8 [3] https://ift.tt/aFO0Pvo We hope to publish a paper on the topic soon.

Comments

Post a Comment

Popular posts from this blog

New top story on Hacker News: Show HN: Zipy.ai - Like Sentry + Hotjar, but with less noise

Show HN: Zipy.ai - Like Sentry + Hotjar, but with less noise 11 by msnkarthik | 5 comments on Hacker News. Hey HN commmunity, Karthik here! Super stoked to announce the launch of Zipy today. Launching the product that you've been so dearly working on for months is like sending your newborn to school for the first time. Excitement to nervousness, anxiety to thrill, all sorts of emotions hit you at the same time. But the entire team of Zipy is confidently looking forward to the feedback you guys have in store for the beautiful product we’ve built. In community we trust! Over the past decade, from being a Web Development Intern to a UX Designer and a Product Manager, I have seen the struggles that both Frontend Dev and Product teams face in terms of understanding user behavior and debugging customer issues. Web technologies evolved significantly, but the debugging process still remained in the stone age. With Zipy, we are trying to change this. Zipy is a product that is primarily o
Read more

Scallops row warnings 'fell on deaf ears', say UK fishermen, after French 'hurl rocks and smoke bombs' at boats

Image
British fishermen have claimed that warnings about an extraordinary clash over scallops in the English Channel fell "on deaf ears". French mariners have been accused of endangering the lives of their UK counterparts after rocks, smoke bombs and other projectiles were allegedly hurled at English and Scottish vessels during the confrontation in the early hours of Tuesday. Around a dozen British boats were targeted by the rival flotilla in a protest over fishing rights in the scallop-rich waters exacerbated by Brexit talks. The Government said it had contacted officials in France about the matter, adding the vessels were "legally entitled" to fish in the area. But some British fishermen have claimed they had previously reported similar skirmishes over the past two years to the authorities. "Nothing happened, it just went on deaf ears," said Brixham-based mariner Derek Meredith. Around a dozen UK fishing boats were targeted by a rival French flotilla in the En
Read more