---

excalidraw-plugin: parsed
tags: ["excalidraw", "speech-synthesis", "audio-models", "vocoder", "neural-architecture"]

title: "hidden-singer-architecture"
created: "2026-02-22"
updated: "2026-02-22"
source: ""
id: "5a93d34f3b17"
origin: "paper"
category: "papers/ai-ml"
summary: "Excalidraw architecture sketch of a Hidden Singer-style speech pipeline combining XLS-R, FFT blocks, WaveNet denoising, quantization, and HiFi-GAN generation."
related: ["['987e59279c46441287b214946efb965aec181921']"]
confidence: 0.88
---
==⚠  Switch to EXCALIDRAW VIEW in the MORE OPTIONS menu of this document. ⚠== You can decompress Drawing data with the command palette: 'Decompress current Excalidraw file'. For more info check in plugin settings under 'Saving'


# Excalidraw Data

## Text Elements
+ XLS-R ^rCIKZbpt

WaveNet
Residual
Block ^hKewyPb0

HiFi-GAN V1
Generator ^nifFg7CX

Total 30 Quantizers - 1024x128 ^S1f53idO

4 FFT ^Oa8j8IQD

FFT 
(Feed-Forward Transforemer) ^ejWLmO6x

4 FFT ^uqDrwQR4

4 FFT ^WwVLK9q4

WaveNet-based Denoiser ^wZpfapE2

## Embedded Files
987e59279c46441287b214946efb965aec181921: [[Pasted image 20250323160509.png]]

%%
## Drawing
```compressed-json
N4KAkARALgngDgUwgLgAQQQDwMYEMA2AlgCYBOuA7hADTgQBuCpAzoQPYB2KqATLZMzYBXUtiRoIACyhQ4zZAHoFAc0JRJQgEYA6bGwC2CgF7N6hbEcK4OCtptbErHALRY8RMpWdx8Q1TdIEfARcZgRmBShcZQUebQBObR4aOiCEfQQOKGZuAG1wMFAwYogSbggAZgoAVXihfQA2AGUU4shYRHLCfWikfhLMbmcAFh5h7QaADgaABmH4hoqARiWA

dh5p/sgYIZ4l8ZnJioBWCp4x9ZmeK62IChJ1biWZ1dXtU/3rq8njn74CyCSBCEZTSbjHc7vGYNVZLMYNGGLf5tCDWZTBbgzW7MKCkNgAawQAGE2Pg2KRyrjrMw4LhAllWiVNLhsPjlHihBxiCSyRSJFSODS6ZkoIzIAAzQj4fBNWAYiSSFkaQJiiA4vGEgDqD0kT2xuIJCFlMHl6EEHlVHNBHHCOTQS1ubFp2DUO3tMyxAIgHK5NuYdtQHCE0uxC

AQxG4w0mG2Ot0YLHYXDQx3iFTjTFYnAAcpwxNxzpMlhU5kdbkI4MRcFBw09VqNVgtngjC7dCMwACJpasRtDighhW7s4RwACSxADuQAurdNMIuQBRYIZLITgGFNeQMoSAAqkyJpAAikTcMdhk0OJqABrMACyI+Y4uGMAA4mKSh1xOg6XiqGuAL4AtOXpEBw+LcEGIbAWwrI1r2/YILckrBGO5TxJMqwICmPANtgwwNMMwxwuhmh7PMeEIOKmgLMcu

AINgSyFvEeyqsw7ifvkbRgA6a5LIBrZclg5S4DMqrYHicDcEUKKDGgnqcRAbqoHJKL3MQjxoDwDRLLGa5SMCoKivammTNocxLPEKYVBUqxWTw8RbJAHBViIBDampuoaVpOnyU5UAufgAAS+lgvaxwegCAHFH+/RSZuPboKQRIjgA0gAWpocCircH6UlgWVejJqCngcUb7PEDE2ec9leop5kmamPDLOcswpjCtyqepqANHEjXxEx5V9Xs6HeSUQIg

iFvDKZAaKmlNaoGoSPLkuUADESwIOt62qsyrJDpy3Kkst/LkIKtL0vlKJITKcqfmqpJlPqGoIG5nXIiU6qGsapp3RatxWpIfoBtxKJOiyrpPB6g4cqO455EBl3kBkKFoBB+D8cQgkSLgSyWnOxCA+BwZo16YSwagRbaRCRbLOmCacE8oy05mHA5hweb2gx8R4cMxw2a2HZdmTfb4AOXqzvti7pCKAao2WFZVmTaz1hZ8SrCm0a3CBYEo0TmvQYS8

XC6LKLVpghnoAA1Kgl4ADJNM4ABKlqUNueXlFbtv207iGcFATSEEYn5LA0PtZAAYrg+hSopI3tHlACCRDKEm6DBOKF0lPGUDmAQicgin0BOqJvu4IQNqkMjga6165IgmXBCu2b7vW3bjuqrgQhQGwDvhAHn64kICHAWXCBBeN5tLEkxwFNFBSxaU8VSMlCAUDAAAKmgidl8C3abGeQIVIyLNoDGaVGvMNjGty1eZEyTIRBFzNc2l9e1OrcA0xzaN

ZKZ4XM8xDUmLcMaBkP5zRmp+OaH1FqHT5OgNaG1EHbRZGyH0B1eSUhOkKc6qorpfVuuaB6JMFrPXfhpR6n0brlEIRGP6whrS2j1DXZ04N3RzT2jDCc8MSjikRggSussvRlwxoVVEyQ6H7QJjrSCKJSbxXvoRfCHwmaJieHZFR2ZcyfgbMHPqwdY6lAFsEbs3AjZDxROLBcS5pZ5DXLFEoW50AIBvEsCgxB4jVEvE0AAasoCwAAhAKPAABW25NSdj

fO0HeQlSA/ggP+PiXpyyVhMfaOs2ELL3zspDYeoFCYyJKGSGCht4LZTdhITUuBGBZgQFAAAOhwHuDghAEAaf4opYE/ou3KegSp1TakNKaSQFp+A2kdNwb7f2gcnghy9OKX2Eco74BjmUs2edk7lDTvvBgTBs7uHWQXLuElbh6CyKXcuAjq4g1IHXJy+BG7mwgH0hANT6mNN7sQEZYz9bt07t3Xu0y0AD3MYUkeY9QH2injPGKQjF7ONce4zxPi/F

GECSEsJETt6dCxrEtgVBbiHxOHEGykwubzDrMMGyFlr5PGOA0BIKweC82uJpLmb93KRjiBUMlcIIQphWMcAxICJrPG/hUI4RYCIVAInSjYtwIGYgoTAjBEgEGbT6GLFBe0uRLTgdALBZ0RS4KlNdE0BD7q0OIU9F6HlyZKqNFQiQNDcZ+ABow+0joWGwAhuw6GY4uGIT4Zcgpm4BKiNwBUF1vp3WoHsdAaJGkIqhjJtcLSqxDjKK9PGZm3A2VZoz

ImVm7NyZMt+GccVwMHFGNqULUpYs8aS2XNkfJxMUTJIVvFJWGTfijHiDMStkAtYtr1sU0xdaURwDYGXZtaAOJtDnW0KaxQZhrm4cUBdxQRhcp5Uypl5VKYOTAM4UVVkJXSuGOe2VkxV2JJRPgUIUAST6CjjIcMa8p0Mmka296URSBQH8cIsuyhh1ekyMQADXIgOSV0mkJtlcl4r3XpvN8EB5nYCEAGZwMxv4zD7VZVWiwXgVCUasByEBlC4AkhpC

YNlpVhTON1FY+wk3ELpFAeOuKKBAlwPFQRKIwMcZ/Nxxe348WqiCLOCgtaRYIGhXPWF5QOCEHFGHZQqwiSXlVDlfkbsCVDHPmKxYaxzJczVqRmqQxZimXPehVYDRGx9uqipMhqA+1JG5f1EzQ01bAOCubYY4CODokgfa3Vq11VbRnFqtBYXjrUkNQyRCJr8HUItSxEhNr8z2pS06tLEiGH+iYSDL1tUckog4f6uGgbI78N41chxYahLDCjfjGNfH

3phk7QRGVMxiwDp2XTFOJxhgaJZloyM5VJjTCpfzTsxjpPGyZA26xK5bGcXsXFcoDR2wAH02A3lIJgZgqVcBh2INUMOWAOCXjDqQbckT43Yq/Jx+JnFIrFDXRAdtqTybpIbL8fC0q0y5O1lXENEAOkLZBXHJuEgAqEDDoQZwz545ZlQN4pYDTnyZCYFWZaXSKAPPKPDxHyPUfo8xxwbH5c8cUlDn7PuMz6eLOjuCVZ7Gk4Fy2aqLOOd8AHMpEXE5

JcR4Vzq+D2u/gG49IgCTpHKO0cY6xzj8gXc6deg7l3IZgLUDAs1mCvzTwoVRRhSiRxEBtt7YO0dk7Z2LtXZu3drTCbntxL02gZwJxJ72fLWsOy2EL00o96cbQ6aERnGuMcfYrxzPOY5WgcVYq+pTYC4RayexZkomFRPel99ow8yjBexqU3gcogVbJULsDwuIMi5q3aMWq9xdOsKRLczkuOrNHlq1hpMseu74SHLnffpen+lIu1zCwberYVDYclXZ

2fd4TV4N37Q0iKEscFrY+43ad4Cx2RnWZkIlw6cJlo3uCktG0Wz8TKjjitPLHqtc2a0lJkzOZbUtVtfrlikxWf3MmA8DxBxAzvX1ih1uEnWnVXE4g3TACXVgNXQchgM9xMnwzQnvjMnT2DkPWDm0DzzGFPHvnLRLxvTaE+3vRxCfRfW7HfWnWAJ/TYwg0cCCzoMgDA0YKgzQDjVgxFHgyUxUzUw0xQzQww0xAmCsgIjVgajD13TIwoyoyKlMiMxh

GmCmB5m5T33oL/UEzxWExYIwC5G0K4xCBExe1uAkzxShzk2KHnnN13H3CPBPDPAvGvDvAfCfFfCxVulE3xQKm4BOESBsnwjhD2H5XKlLxKEUmPSjAmGDm6jmDCmM3ZU6kmGwzrCJThFeHOCuDekBENzQDc0pXTTrEYyI1hHlSC1mkrxVXgQiw1QsWizxli3QAFGwSNSS2lEHx+iIVkQyxc362gQdTNVS2HxRFHxjX61BhdCn3JjKxKAq1hnn2qyR

nFxX1KEayxgaE3xjW3xdx4A0IEAPzQFszCh+FwzPw0lP3zUGyv0jGIybDwn6zbCfx+zMTfwlhWxnTB1WO+1/2VhTCj0c31zyS/yglHTglfy9AgM/1QA3RgLgJXU4jXTABgJSNDwvSpmwnWBZRyM3QKNeBeDwj2FKN4kRNvUKQfUoLUGoI/XNnawEF/X/UA2YJBP4y5HYOZNjRgw+PgyaCWHFFOBIAAHkhDoIRDZJTICTgjsJBUwpi9NJZDKNuA3h

Vh0JrgC9uoLI1Zhh9j5o2NDDdCWSSgBNOMDTXcxMzD8BJNLCTd5MzdF5eT+SKghTncntoBdNfCE87IkhP5xU4iGxDh+tIjNJc8UjSVGwtSZgDEOpbUmV6VrhXhFgYQKohU8jJpyjgtFV+9iRG8aia86imQGj9omj9V4sW9tk8EO8ujLUejrU+jstKznV8s3VCs+9itJ9StfVZ8FiYSF8g0Vj0ZMYvxVgtiWyvjk14pixpVj9P5ziS05ps1C1xtkx

sJCxyVwjNxq0Xjx0lt3iP9PiN0NsF5yg7DDxjxTxzwrxbx7xHwXwHsd9UQXsElSDv8O1aw/iLJS0RsgDDTB1QCX9FsYdHltw2Aoh8BUBixUADwWksg+4WBUBnAZixhMAiJnZCcZdgLQLwKZhILoLs5A44KELngkKUL6cpkg5M8eEFlI5Wdkx2cBcJBudaY9lc5OdBdjkvRTkohRdl9HQbkpd7l0KQKCAsKcLrA8KMx4LELhhkKNhfktcAV+5SBB4

gTR5UzJ4mUrD1w7TyhBTcBJhglJgRwDx2wXTd53TpJIwwokg1Ywpz4SwQig9yZJ5iNeo+pKUUjlg0IkjbUrLupuVKV9gThTx7NfNx58xAsMyK8sziy1UkEot69GicySzm8cF2jTVvpGysze9x8azKEhjcsRiSgxjRyJiSsfUZ9yw58eyljas9DhFBzURJgRyZZ6sDjFZ5hupAcWwric13QnNM4C1NE2ZPwwzsJoQVhZtBZ/zocIBLFiBG0bEfyvt

5Yfsu0GxZhuVpgDEh0lrIdpr2dyhhhUAw4w57sCcicJAjqTqzq5lJlGd7QKKJQqKlkVkvQ956LU4KJtled9lWL+QhcOKRcLl+ya4+L64BLYd0ArrTq5L/lWAdc9dclVKwrIUNKbTrCFMJAEBglNQbZ9BBSGhBhPDcom53cuozhQ86U+peZuUiw+YLM0A4yS90JrJOYiwL8vRoz8wNh3h1Z9g1DeVQqIVUAAt0zKjoqkrYra96iEqiykqWiEtyz29

8qh9uif1az48cr1a8qMqu9Rj6FmygZPV2zyqvR5iA05k+y6r1ivx4hmq9C5EnhNT6NzIH9IAFz6ZQp+sPaxthrc0ptfhrgThJr5t9r61dym0La20VrfiMkNrZgpggTQc6SIc/yx0ISTYZdrrUAGkAAKS7cMZwMOckCgOkYgVAbcLBeZQIDIUgAASlQouvQGzrzoLuICLpLrLorqrvJClnromSyDIqZ1uvDmouWTZzeoTj+s+vTh512T5w+sLnYpR

E4vOSYB4tBtuWl0hogBbo4Hzs6w7tIFLtIHLsrupGrr7obvlT+W10UuUqRvBRFWNzAFngxu0okCEAAEd2xj6DwHZmtiadNSaPSRbojrIiNowNgrI6xHLP475RhixKVTwwoFhvLwRsM/LTNArBU8J+rciUa0yNcKiQsJbqiIApb8zIAdpUFEryGFayzjUOiGy9btatQ6yszOjMr9bXUx9SqTbp8za/VuypwaqN6zcbbUR457alrHajJVZGpg5g6er

VE0l5zBrfbi0qZcMYQrIQ7n906ALZr39I6qskkY7O0/9ZgL1ixtqy5k7WrU6wTUBXjJ6d7oabrRjul3HjqYbSL7ryZHrUNnqaKio6Lp6Icvq56/0F6Imjli4zluKQbrkt6IbHkPHYa77uBEa70DdCH1Lp50atKHFF5NQKBvEbZkp4gv7AG3qXc3SQGLKNJCw0ToRlg4Q4QCTHLnhnLowX4tJiNVYIR0HkxMHeoAr0Tgr8G9JCHrgxbSHcrlUjpcz

1VkFZadV5aDVGG0quHWH6SNbOp+iSFdnCrIBiqjaJ8piOyKrOEzGEYl9kmGs18sZ/EZGxySZDjeBng1Y1gERvaNG/D1hL8lzyY6UfhbJX4hFNywDw6rE9yo6SgfjLHlYWpuUyjvz3mQDnHXHM6fHrrG6ZcMn/GdcsCR6oAWdx7aK3GOd85NkommLYnaX/rl6ShV6km9DJdwam6IAiWNdb6FLsmlKZqQJkbhaCnNKbDF4KBUo4A+w4B5xxE6nXS95

VRD4ixUjcNeppUtImU8JuncNTJrgwy+1T5bMRnyY3NsIGITgzhYRC8vys9Uy5niHIqlIqjlmKHai1naG5b6GtnUq29mGVaqz0sDnbUjmnoTm1azmDa+HjarnTbythGEWJQralr6rw0iQ3mU65GZje1dXIzZzE6VGhri01gptw9VZ9GtyM6dy4XTGlqkW3y46Xhyoxgk69C9rDGZqVWKkqkXlalnBmQwhy7OwOAp0wh1cvG0Kd7nlXkh3QhwxUAx2

J2mAB6GcSWgn5lR6XqJ7cWaWNkGL6WrjmL+c4mAaV6gb17HnIBOW7luW53B3h2l2V22w12b75L4b77hW8mxWX7Ip4ZUQ4A4BZQFZoN3wgQMhNkwr+gGBCAV5/FCyNnyGVpxQ0P0PGQIB0NYkeDqx9BZQnoYqvXYPsPzoRw8PEP1n0EPWGGA3WWRAyO8PEcg3dbCqsOGPcP0gCOe8OH6OcOshyOuPjmWG2PSPOP9AHZY3xiSOOOBO8PBSyrBG+PGP

0hi6d3QmRp2P+OoBBP9A1ON3yKZPtPdOHlF7GKCgtOVP8OGT9TjC6DLPxP5wDCTS7OcU3cLOxO5P0hDDtx6m0FMPWI8RpRNNkwrNOqg7CCfTwi1QxJSR8AABNSMY+JM4jYjbqClaVWDowNgAwcDzOAgQeUQ++fYNYTShzrziTvGMfb0PGTD9kEgIejSZScjG5YgWUBAeQzT+r4gG8NgDGJz3ATQYIMOuY1rpo+efxUkReUgZQZkXOvYUjL5xbhb6

gJSd4a+r0HuZQYMOkcoGbubxqLEXgYsVbw71b7DY4Busrzzv2EhBT7OTgFqgpVDPhHuASG5Dk+eTIQb4bwVh+leogeQnJkoJyKDoFIVx0TuEVv72TIpiAOwYJOibIc8SjXr/rpyIbmFkoFkbORgYC0kPLqJV0sIYIbAB7rgE5DDLufQXzp7FOrt8Eox8g9jMnwgPHnL/AFtGecAN+1DKUcISSACP8IAA
```
%%
