Through a gap in the curtain…

Another day, another brief slip. The following Yamaha Montage information is taken from a credible posting at the gearslutz.com web site. It adds to the information that was inadvertently revealed earlier. Of course, all news before the official unveiling is unverified! If I’m all wrong about this, I will be the first one to have a good laugh! A good laugh is healthy. 🙂

  • AWM2: 128-note, stereo polyphony.
  • New AWM2 waveforms: Yamaha CFX Premium Grand Piano, Bösendorfer Imperial Premium Grand Piano, strings, woodwinds.
  • FM-X: 128-note polyphony, 8-operator voice architecture.
  • FM voices taken from the DX and TX series.
  • DX-to-FM-X conversion utility is in development.
  • Seamless Sound Switching (SSS) for Performances with 8 or fewer parts; no more sound cut-off when changing performances.
  • Envelope follower to extract a routable, control envelope.
  • 1.75GByte of internal user flash memory.
  • Class compliant USB with multiple audio channels back to a DAW.
  • Sampling rate up to 192 kHz.
  • VCM effects including a compressor with sidechain; damper resonance.
  • Pure Analog Circuit (PAC) postprocesses after-DAC audio.
  • Eight rotary encoders and eight sliders.
  • Direct Control Assignment for convenient assignment of parameters to physical controls.
  • 61- and 76-note models have FSX action and aftertouch.
  • 88-key model has fully-weighted balanced hammer action and aftertouch.

Thank you, thank you, for SSS!

The 128 stereo polyphony for AWM2 is interesting given the way Yamaha assigns voice generation elements on the fly. Also, given Yamaha’s tone generation scheme, this is true polyphony. Not to diss the Kronos, but Korg have to publish a lot of fine print about voice/effect trade-offs because the Kronos synthesis engines and effects share the same x86 cores.

Hopefully, the stereo polyphony spec implies a greater use of stereo waveforms for AWM2 voices. Improved woodwinds would really be a God-send for me, not to mention the new acoustic pianos. No word on the electric pianos or B3 organ emulation, though, so I’m still holding my breath. SCM, where are you? The latest reveal mentions “synth libraries from yamahasynth.com.” It would be cool (and useful!) if Yamaha follows the path taken by Nord with their downloadable sound libraries. Aftermarket accessories and sounds drive sales as well as a thriving environment for third party developers. I hope the Montage ecosystem ramps up fast.

One poster noted that 1.75 GBytes of user flash memory is kind of an odd amount. The Montage uses the flash memory scheme that is employed in the most recent arrangers. The flash memory feeding the tone generator holds both the factory voice samples and user samples. Users basically get whatever space is left over from the factory set. Yamaha essentially reserves this much space in the physical memory for your own use.

The motion control and motion sequencer appear to be similar to features implemented in the old Yamaha AN200 and DX200 table-top groove boxes. These allow dynamic control of multiple parameters for sound “morphing.”

The Motion Control Synthesis Engine “unifies” the treatment of AWM2 and FM-X voices across zones and layers in a Performance. Transparency of operation is good.

The visual styling is very nice! Rakish. (Always wanted to use that word.) The Montage appears to be physically smaller than the Motif. Hopefully, the Montage weighs less, too. Yamaha may get slagged for the lack of readable panel markings in low stage light.

Overall, pretty good stuff and I can’t wait to hear more!

Yamaha has now released the official Montage teaser video. If you’re on their mailing list, check your in-box. Otherwise, cruise on over to Youtube. (I don’t usually post Youtube links. You know how to use the Interwebs.) The video confirms the images that we have seen so far.

Yamaha has also opened up the Montage forum on yamahasynth.com. No manuals, yet. 🙂

More than a few people noticed that sequencing capabilities have not been mentioned in the leaked promotional material. Right now, it’s hard to read anything into the absence of this information. We’ll need to stay tuned, but don’t Bogart that Motif/MOX yet! It’s still an incredible time to buy a Motif XF, BTW, with the “Fully Loaded” package and all.

In case you missed them, here are links to two of my earlier posts speculating about the Montage:

New Yamaha workstation at NAMM 2016?
(Re)take the stage

Some hits, some misses.

New Yamaha workstation at NAMM 2016?

True gearheads are already making predictions and plans for 2016 Winter NAMM, January 21-24, 2016. Winter NAMM rumors abound including “Montage,” the rumored name for the rumored new Yamaha synthesizer workstation.

See the list of new waveforms in the Montage and read my initial review of the Montage8. Update: May 10, 2016.

Find the latest links, pictures, rumors and facts here . Update: January 21, 2016.

Check out some new thoughts about the rumored workstation and preliminary comments . Update: January 18, 2016.

Many folks — myself included — anticipate the release of a new Yamaha synthesizer workstation at the next NAMM. Much has been made of the registered trademark “Montage.” I don’t really care too much about what they call it, as I care about what it will do.

Last month, I posted two articles about the new Yamaha tone generation chip called “SWP70”:

This chip made its first appearance in the new PSR-S770 and PSR-S970 arranger workstations. Lest anyone scoff, the S770 and S970 produce Motif-caliber sounds including the REAL DISTORTION effects added to the Motif XF by the v1.5 update. The previous tone generator (SWP51L) is used throughout the mid- and upper-range Yamaha keyboard products including Clavinova, MOX/MOXF, Motif XS/XF, and Tyros 4/5. The number of tone generator chips varies by product specification and, most notably, sets the maximum available polyphony. A new tone generator chip is a pretty big deal since it will have an impact on all mid- and high-grade electronic instruments across product lines.

My earlier article about the SWP70 is written from the perspective of a computer architect and is way too nerdy for normal people. 🙂 Let me break it down.

Musicians using VST plug-ins within a PC-based DAW are familiar with the concept of sample streaming. In the quest for greater realism and articulation, sample libraries have become huge. These libraries simply cannot fit into fast random access memory (RAM) for playback. As a work-around, a software instrument reads samples from a drive-based library on demand and only a small part of the entire library is resident in RAM at any given time. The process is often called “sample streaming” because the software instrument streams in the samples on demand from a large fast secondary memory like a Solid-State Drive (SSD). The Korg Kronos workstation caught everyone’s attention because it incorporates an x86-based software system that streams samples from an SSD. (For Kronos-related articles, look here and here.)

The SWP70 combines streaming with tone generation. It does not, however, use an SSD for storage. Rather, it subsumes the functionality of the SSD. A moment to explain…

An SSD consists of three major subsystems: SATA controller, temporary storage cache (RAM) and one or more NAND flash memory chips. The NAND flash memory chips typically adhere to the Open NAND Flash Interface (ONFI) standard. This allows expansion and standardized configurability. The SATA controller exchanges commands and data with a computer using the SATA bus protocol. The temporary storage cache holds data which is pre-read (cached) from the NAND flash chips. Caching is required because random access read to NAND flash is too slow; sequential paged access is much faster. Data must be prefetched in order to achieve anything like SATA 1 (2 or 3) transfer speed.

The SWP70 subsumes the SSD functionality. It has its own memory controller and has a side memory port to its own RAM for caching samples. The SWP70 reads samples from its ONFI-compatible NAND flash memory bus and stores the samples in its cache. The tone generation circuitry reads the samples from the cache when it needs them. The SWP70 solution is, effectively, sample streaming without the added cost and latency of SATA bus transfers. The samples coming into the SWP70 from flash are compressed, by the way, and the SWP70 decompresses them.

The SWP70 will very likely make an appearance in the new Yamaha synthesizer workstation. The S770 and S970 do not make full use of the SWP70, so we have yet to see what this chip is fully capable of. We can definitely expect:

  • Much larger wave memory (4GBytes minimum)
  • Greater polyphony (256 voices or more)
  • More simultaneous DSP effects (32 units or more)
  • The demise of the expensive expansion flash DIMMs

I would simply love it if the new workstation implemented some form of Super Articulation 2 voices (now supported by Tyros 5). The raw resources are there.

User-installed expansion memory may be a thing of the past. The current DIMMs plug into a two channel, full parallel memory interface. That interface is gone and the SWP70 communicates with flash NAND through an ONFI-compatible interface. The Motif and Tyros follow-ons will likely reserve space for user samples and expansion packs in built-in flash memory just like the new mid-range PSRs.

What does Yamaha intend to do with all of this polyphony? Current high-end models like the Tyros 5 use two tone generation chips. Yamaha could replace both chips with a single SWP70 and pocket the savings.

Another possibility is to provide advanced features for musical composition that combine MIDI and audio phrases. Here is a list of technologies covered by recent Yamaha patents and patent applications:

  • Beat detection and tracking
  • Chord detection
  • Synchronized playback of MIDI and audio
  • Combined audio/MIDI accompaniment (time-stretch and pitch-shift)
  • Object-oriented phrase-based composition on a time-line
  • Accompaniment generation from chord chart
  • Display musical score synchronized with audio accompaniment
  • Phrase analysis and selection (via similarity index)
  • Near ultra-sonic communication of control information
  • Search for rhythm pattern similar to reference pattern

A few of these technologies are covered by more than one patent — recurring themes, if you will. I could imagine a screen-based composition system that combines audio and MIDI phrases which are automatically selected from a database. The phrases are transparently time-stretched and pitch-shifted. Some of the compositional aids may be implemented in the workstation while others are tablet-based. The tablet communicates with the workstation over near ultra-sonic sound (no wires, no Bluetooth, no wi-fi, no time lag).

Sample-based tone generators already perform pitch-shifting. That’s how a single sample is stretched across multiple keys. A musical phrase can be pitch-shifted in the same way. As to time-stretching, stay tuned.

Some of these features, like accompaniment generation from a textual chord chart, are more likely to appear in a future arranger workstation product. Making product-specific predictions is a risky business, especially if you want to get it right!

Yamaha — the business — is keenly interested in growth and expanding markets. Management sees opportunity in growth markets like China. The need to combine audio phrases with MIDI is driven by non-Western music: time signatures other than 3/4 or 4/4, different scales, different playing techniques and articulations. These concerns are perhaps more relevant to the arranger product lines. However, phrase-based composition that manipulates and warps audio and MIDI transparently is a basic feature of many DAWs. (Think “Ableton Live.”)

One final theme seems to recur. Yamaha appear to be interested in analyzing and accompanying non-keyboard instruments. The market for guitar-driven accompaniment is much wider and deeper than today’s arranger workstations and is a lucrative target.

Here are links to a few earlier articles, including speculation about the new Yamaha synthesizer workstation:

These articles link to further background information. Of course, we’ll know a lot more once Winter NAMM 2016 is underway!

All site content Copyright © Paul J. Drongowski unless otherwise indicated.

Clear the decks?

Yamaha have announced a truly stellar promotion to move Motif XF workstations. The Motif XF Fully Loaded expansion pack includes a FireWire expansion board, two FL1024M memory modules and an USB drive filled with content including Chick Corea’s Mark V electric piano. (See the promotions page at the Yamaha web site for additional details.)

Wow! This promotion really caught my attention and if ever there was a time to upgrade to an XF, it’s now.

Of course, this aggressive promotion could also mean that a new synthesizer workstation will be announced in the not-too-distant future. Winter NAMM 2016, perhaps? Old inventory has got to go!

After the Reface surprise, I’ve given up predicting specific product features, especially based upon a (rumored) product name. The word “Reface,” for example, means something completely different to a saxophone player and, yes, Yamaha manufacture saxophones and mouthpieces. 🙂 So, “Montage”, harumph. I am willing to predict, however, that the next high-end workstation will have a new member of the Standard Wave Processor (SWP) family — the hardware chip that underlies the tone generation infrastructure. (See Serial Memory and Tone Generation.) This is big step for Yamaha because the current SWP51L, for example, is used in everything from mid-range arrangers, to MOX/MOXF, to Motif, to Clavinova.

Just taking in the gestalt of Yamaha’s recent patent filings, they have been actively building their portfolio in at least three areas: human vocal processing and synthesis (VOCALOID), music analysis and combined MIDI/audio accompaniment.

VOCALOID has been a commercially successful software product. The tech has, by the way, some similarities to the “connective” capabilities of Articulated Element Modeling (AEM), known more broadly as “Super Articulation 2” on Tyros. VOCALOID requires frequency domain signal processing, so unless Yamaha have knocked down some real computational barriers, VOCALOID will probably remain a non-real time synthesis technique.

“Music analysis” is a broad area and a rather vague term. At a fundamental level, this area includes beat (tempo) detection and scale and harmony (chord) detection. I think we already see some of these results at work in the Yamaha Chord Tracker app. Chord Tracker analyzes an audio song. It detects the tempo and beats, and partitions the song into measures. Chord Tracker identifies the chord on each beat and displays a simplified “fake sheet” for the song. Chord Tracker can send the “fake sheet” to a compatible arranger keyboard for playback.

Music analysis also includes high-level analysis such as extracting the high level characteristics of a piece of music. This kind of analysis could allow a rough categorization and comparison between snippets of music (similarity index). We haven’t seen the fruits of this technology (yet), but one could imagine a tool that suggests an accompaniment based on what the musician plays or based upon an existing musical work. BTW, the word “musician” here includes guitarists, woodwind players, etc. and not just keyboardists. The world-wide market for non-keyboard instruments is bigger than the market for keyboard-based instruments. (Guitars alone outsell keyboards nearly 2 to 1 in the United States.)

The third main area of exploration and filings is combined MIDI/audio accompaniment. Up to this point, Motif arpeggios are MIDI-like phrases, not audio. Arranger workstation styles are MIDI (SMF in a Halloween costume). Neither product works with MIDI and audio phrases in a transparent way like the very successful Ableton Live. Yamaha’s patent filings disclose arpeggio- and/or style-like accompaniment using a mix of MIDI and audio phrases. Audio phrases are warped in time and pitch to match the current tempo and key scale.

Now, let’s throw these technologies into a bag and shake them around. Imagine a compositional assistant that analyzes a piece of music (recorded or played live), determines tempo, beats, chord changes and more, and automatically whips up an accompaniment or track. MIDI and audio phrases are selected from a library based upon a similarity index between the reference track and phrases in the library. If this is Yamaha’s vision, then double wow! The combination of these technologies would raise the level of music composition substantially from it’s tedious, point-and-click existence. It finesses the problem of listening to the phrases in the Motif/MOX arpeggio library, selecting the most applicable phrases and combining them. DigiTech TRIO is already sniffing around this territory.

Naturally, patents do not imply product. Therein lies the danger of making predictions.

Which brings me, finally, to US Patent 8,779,267 (July 15, 2014). If someone can explain this patent to me, thanks. The invention seems to analyze an incoming musical signal (using some heavy DSP), generate almost ultra-sonic (>18KHz) “control tones,” and produce a multi-timbral accompaniment or track. Amazing stuff.

The near ultra-sonic technique is already in use. The AliveCor Mobile ECG monitor uses ultrasonic tones to communicate with iPhone/iPad. The AliveCor doesn’t require power-sucking Bluetooth (and its emissions certification.) The monitor runs on a CR2016 battery. The downside, in the case of AliveCor, is that its monitor pad must be near the mobile device for reliable communication.

All site content is Copyright © Paul J. Drongowski unless otherwise indicated.

What’s in a name?

Anything that we want to go from just a beginner to a pro,
You need a montage (montage)
Oh, it takes a montage (montage)
Team America Lyrics

Back in January before Winter NAMM 2015, there was a lot of speculation about a new Yamaha workstation to replace the venerable Motif product line. Yamaha filed for the trademark name “Montage” in December 2014 and many wondered if this would be the name of the new workstation. (Yamaha have a teaser ad for “Reface” at https://www.yamahasynth.com with a countdown clock leading up to Summer 2015 NAMM week. Your guess is as good as mine!)

Getting a little bit Zen for a moment, it doesn’t matter what a thing is called. All that matters is what the thing is.

Periodically, I troll the United States Patent and Trademark Office (USPTO) database for interesting patents and patent applications. Yamaha carefully (and wisely!) protects its inventions through patents. Yamaha R&D, by the way, rarely publishes in the scientific literature, which is another way to stake your ground. Patent protection is stronger legally. A patent costs money, so a corporation is usually serious about a technology when it makes the commitment to file. The Yamaha patent applications cite Japanese applications/patents to establish priority in the United States. Thus, there is usually an existing Japanese application or patent that was filed at an earlier date for each US application.

Of course, a patent does not necessarily indicate that a product will follow. However, I’ve noticed a trend in some (relatively) recent filings by Yamaha.

Let’s start with US Patent Application Publication 2013/0305902, “Accompaniment Data Generating Apparatus,” published November 21, 2013. Quoting the application, “An object of the present invention is to provide an accompaniment data generating apparatus which can generate automatic accompaniment data that uses phrase waveform data including chords.” This rather lengthy patent application describes a musical instrument keyboard that uses audio waveforms in the same way that an arranger or Motif-series workstation uses MIDI phrases (AKA arpeggios). The application cites Japanese Patent Publications No. 2900753 (MIDI-based accompaniment) and No. 4274272 (MIDI-based arpeggio performance) as prior art.

US Patent Application Publication 2013/0047821 (published February 28, 2013) covers similar ground. This application adds waveform pitch shifting and time stretching. It cites Japanese Patent Publication No. 3397082 on the specific capability of pitch shifting and time stretching. Audio phrases (waveforms) need to be transposed via pitch shifting and must fit into the rhythm via time-stretching.

US Patent Application Publication 2013/0305907 (published November 21, 2013) is related to the previous two application. It covers production of chords using audio waveforms, guided by chord root and chord type.

US Patent Application Publication 2014/0033902 (published February 6, 2014) is titled “Technique for Analyzing Rhythm Structure of Music Audio Data.” The technique described in this application identifies the beat positions and intervals in a piece of music in audio form (i.e., rhythm pattern analysis). Figure 1 shows the embodiment (design) of the technique within an accompaniment generation system. The beat position information is used to synchronize playback of both MIDI and audio phrases. The diagram shows a “MIDI reproduction section” and an “Audio reproduction section.”

The most recent publication is 2015/0154979 (June 4, 2015) and is titled “Automated Performance Technology Using Audio Waveform Data.” The application deals with a specific issue that arises when audio waveforms are used for accompaniment (pitch shifting and time stretching). Quoting the application, “it is an object of the present invention to properly deal with a processing delay and sound quality deterioration that are likely to occur when audio waveform data is reproduced with time axis expansion/contraction control performed on the audio waveform data in accordance with a desired performance tempo.”

These are long documents with a lot of detail expressed in excrutiating “patent language.” They are too long and detailed to summarize here. I recommend downloading the patent applications from the USPTO, brewing coffee, and then reading the applications.

Looking at the overall trend, Yamaha are thinking about automated accompaniment that incorporates both MIDI and audio phrases. This technology could be applied to arranger instruments or a new generation of synthesizer workstation. The latest arrangers have “audio styles” which only use audio for the rhythm track. No “harmonic” phrases (e.g., bass line, electric piano comping, etc.) are available. The current Motif generation (the XF and MOXF) have only MIDI-like arpeggios. Possibly, combined audio/MIDI accompaniment was not fully cooked in time for the PSR-S950 and Tyros 5.

I am very interested to see if Yamaha rolls out this technology in future products. The definition of “montage” is “the process or technique of selecting, editing, and piecing together separate sections of film to form a continuous whole.” Hmmm.