<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[Usman Kalera]]></title><description><![CDATA[Usman Kalera]]></description><link>https://usmankalera.hashnode.dev</link><generator>RSS for Node</generator><lastBuildDate>Sat, 24 Oct 2026 11:04:17 GMT</lastBuildDate><atom:link href="https://usmankalera.hashnode.dev/rss.xml" rel="self" type="application/rss+xml"/><language><![CDATA[en]]></language><ttl>60</ttl><item><title><![CDATA[Switch-Point Prosody: Why AI Voices Break Where Pakistani Ads Switch Languages]]></title><description><![CDATA[A research proposal by Muhammad Usman, BS Artificial Intelligence, Superior University, Lahore — October 2026]]></description><link>https://usmankalera.hashnode.dev/switch-point-prosody-why-ai-voices-break-where-pakistani-ads-switch-languages</link><guid isPermaLink="true">https://usmankalera.hashnode.dev/switch-point-prosody-why-ai-voices-break-where-pakistani-ads-switch-languages</guid><category><![CDATA[AI]]></category><category><![CDATA[research]]></category><category><![CDATA[text to speech]]></category><category><![CDATA[speech]]></category><dc:creator><![CDATA[Muhammad Usman SU92-BSAIM-F25-025]]></dc:creator><pubDate>Wed, 14 Oct 2026 06:03:03 GMT</pubDate><content:encoded><![CDATA[<h2>The phenomenon</h2>
<p>Walk through any commercial break on Pakistani television, or scroll through sponsored video ads on Instagram and TikTok, and a linguistic pattern repeats: the pitch is neither pure Urdu nor pure English. It is a deliberate mix — Urdu as the matrix language carrying the message, English insertions carrying prestige, urgency, and the call to action:</p>
<p>"Yeh phone best hai — limited offer, abhi order karo!"
"Naya smart TV sirf Rs. 85,000 me — free delivery ke saath!"</p>
<p>This is not sloppy speech. In Myers-Scotton's Matrix Language Frame model, bilingual speakers systematically embed one language's content morphemes inside another language's grammatical frame, and advertisers exploit this: English words signal modernity and trigger the purchase impulse, while Urdu carries trust and cultural proximity. The persuasive force of the ad lives exactly at the switch points — the emphatic stress on "best", the rising pitch into "order now!"</p>
<h2>The problem</h2>
<p>AI-generated voiceovers are now cheap enough for Pakistan's small businesses to use in video ads. But every practitioner who has tried knows the failure: feed a code-switched script to a TTS engine and the voice stumbles precisely where the ad needs it to soar. The Urdu words come out with English phonemes, the stress lands on the wrong syllable, and a flat pitch contour replaces the salesman's rise.</p>
<p>I verified this with a live demonstration: synthesizing "Yeh product best hai, order now" through a production English TTS voice, the Urdu function words receive English phonemization, stress defaults to English patterns, and the persuasive pitch rise into the call to action is absent.</p>
<h2>What the literature says</h2>
<p>Code-mixed speech synthesis is an established field — but for other language pairs. Sitaram and Black (CMU) built an early Hindi-English framework and found significant listener preference for systems that correctly identify and pronounce words in each language. Joshi and Garera (2023) reached production quality for Hindi-English e-commerce voice bots with a positive comparative MOS against a commercial baseline. Mandarin-English bilingual synthesis was demonstrated at Interspeech 2020, and an ICASSP 2020 system explicitly predicted log-F0 because phonetic representations alone lack the prosody code-switched synthesis needs.</p>
<p>Crucially, the prosodic disruption at switch points has been measured: a Chinese-English bilingual speech study found English words inside code-switched utterances showed nearly double the pitch variability of monolingual speech — average F0 standard deviation of 51.9 Hz versus 29.8 Hz. Speakers measurably alter their prosody around switch points, and a TTS system trained on monolingual prosody misrenders exactly those regions.</p>
<p>The gap: no published work addresses Urdu-English switch-point prosody, and none targets advertising persuasion — despite Urdu-English mixing being the everyday reality of hundreds of millions of speakers.</p>
<h2>The proposed study</h2>
<p>Phase 1 — Corpus: 50 code-switched Pakistani ad scripts, 5 native bilingual speakers, switch points annotated.
Phase 2 — Acoustic measurement: F0 contours via pYAAPT; compare 300ms windows around switch points against monolingual windows; synthesize the same scripts with commercial TTS engines and repeat.
Phase 3 — Perceptual evaluation: ABX listening tests (n ≥ 40): naturalness (MOS) and purchase intent ratings.</p>
<p>Expected contributions: the first acoustic characterization of Urdu-English switch-point prosody, a public annotated corpus, quantified human–synthetic prosody gaps, and a prosody-aware synthesis recipe evaluated on purchase intent — the metric advertisers actually care about.</p>
<h2>Honest framing</h2>
<p>This is a research proposal — the study has not yet been executed. Findings from Hindi-English and Mandarin-English systems may partially transfer, which would narrow but not eliminate the novelty. All literature claims are verifiable through the references in the full paper.</p>
]]></content:encoded></item></channel></rss>