The Linguistic Coordination Of A Convergence Of Language With Language

Ngo, Hood, Martin, Painter, Smith & Zappavigna (2022: 207):

From the perspective of instantiation (the system to text relation in SFL), this raises the central challenge of intermodal studies, namely, the ineffable process whereby systems from different modalities end up seamlessly instantiated as coherent text. As in film (van Leeuwen, 1985, 2005), textual meaning has a critical role to play, as the ‘beat’ of feet and tone groups (TONALITY, TONICITY, SALIENCE and RHYTHM) coordinates the convergence of linguistic and paralinguistic resources (the focus of Chapter 6).

Blogger Comments:

[1] To be clear, instantiation is the relation between potential and instance at a given level of symbolic abstraction, of a given semiotic system. For example, instantiation is the relation between the system of phonology as potential, and an instance of that system in a text; or the relation between a system of paralinguistic content, and an instance of that system accompanying an instance of linguistic content.

[2] To be clear, the ineffability of grammatical categories means that they only mean themselves. Halliday (2002 [1984]: 303, 306):

The meaning of a typical grammatical category … has no counterpart in our conscious representation of things. … they do not correspond to any consciously accessible categorisation of our experience.

[3] To be clear, the expression plane systems that realise the grammatical system of the information unit are language, not paralanguage, whether vocal or gestural. So there is no coordination of a convergence of linguistic and paralinguistic resources.

[4] Trivially, SALIENCE is a lexicogrammatical distinction realised by distinctions in RHYTHM, its phonological counterpart. 

[5] To be clear, Chapter 6 presents a system of DEIXIS which classifies referents, and a system (though no network) that merely correlates speaker location with categories from writing pedagogy.

Misrepresenting Cléirigh's Model As The Authors' Innovation

Ngo, Hood, Martin, Painter, Smith & Zappavigna (2022: 207):

As reviewed in Section 7.1, our project involves developing paralanguage as a semiotic system alongside language. We adopted our model of the relation of paralanguage to language from earlier work on the convergence of language and image in children’s picture books (Painter et al., 2013). As outlined in Table 7.1, sonovergence was explored in terms of how linguistic and paralinguistic systems resonate with one another (interpersonal meaning) and sync with one another (textual meaning).

Blogger Comments:

This is very misleading indeed. The origin of the notions of gestures being in tune with TONE, and in sync with TONICITY and RHYTHM is Cléirigh's model (2009), which predates, by four years, the "earlier" work on the convergence of language and image in children’s picture books (Painter et al., 2013):

The plagiarism in this work is effected through myriad small steps with Martin, the author of this chapter, the driving force.

Why The Model Of Paralinguistic Periodicity Is Invalid

Ngo, Hood, Martin, Painter, Smith & Zappavigna (2022: 194):

In spoken English, prominence is composed through the TONALITY, TONICITY and RHYTHM systems of prosodic phonology. It is also composed in multiple layers of predictive prominence in discourse, from clause-level Theme to hyper-Theme to layer upon layer of macro-Theme, and in layers of aggregating prominence from clause-level New to hyper-New and so on.

In the face-to-face discourse of live lectures we have noted the potential for expressions of prominence at multiple layers in discourse to synchronise aurally with prosodic phonology and visually with PARALINGUISTIC PERIODICITY. Such intermodal convergences amplify the prominence of the meanings involved.

Blogger Comments:

[1] To be clear, in spoken English, the phonological resources for assigning prominence are TONICITY and RHYTHM. TONALITY is the system for selecting the distribution of tone groups.

[2] To be clear, the grammatical resources for assigning prominence are "clause-level" Theme and "information unit-level" New. As previously demonstrated, the authors' avoidance of the information unit allowed them to make an unwarranted connection between grammatical Theme and discourse semantic hyper-Theme and macro-Theme.

As previously pointed out, Martin's 'hyper-Theme', 'macro-Theme' and 'hyper-New' are rebrandings of terms from writing pedagogy: 'topic sentence', 'introductory paragraph' and 'paragraph summary' respectively.

[3] This is misleading because it is untrue. All the authors have done is describe the movement of a lecturer around his lecturing space and correlated his position in space with what he was saying at the time. They provided no evidence that the position assigns prominence, or that it realises the correlated discourse semantic category, such that the position identifies the meaning or the meaning identifies the position.

Significantly, the authors produced no system networks to theorise their system of PARALINGUISTIC PERIODICITY, their system of meaning named after a structure type.

Some Problems With Paralinguistic Macro-Theme

Ngo, Hood, Martin, Painter, Smith & Zappavigna (2022: 191, 192):

In example (23) we move up one level in the hierarchy of periodicity from the hyper-Theme to the macro-Theme that immediately precedes it.

Sonovergently, the lecturer takes three steps in sync with three silent beats prior to the commencement of the macro-Theme in (24). This takes him from a space on the left to reach the central desk. Synchronous with the commencement of the macro-Theme, the last one is the distal convoluted tubule, he takes off from this central position, moving to the right. On completion of the macro-Theme, he rotates his body 180° to face left and continues stepping backwards in sync with the two silent feet that precede the hyper-Theme. 

This sequence of movement and body orientation is depicted in Figure 6.7. The lecturer ends up on his ‘launch pad’, the position from which he delivers his hyper-Theme before taking off in sync with a new phase of discourse.

The body movement and thematic development are well coordinated. Footfalls in Figure 6.6 synchronise with clause-level Themes and anticipatory positioning scaffolds higher levels of Theme – the lecturer’s positioning to the right of the lecturing space syncs with the hyper-Theme and centre-stage (desk) positioning syncs with the macro-Theme.

Blogger Comments:

[1] To be clear, 'macro-Theme' is Martin's rebranding of the 'Introductory Paragraph' of writing pedagogy as linguistic theory. As linguistic theory, macro-Theme, like hyper-Theme, is a function without a structure: there is no 'macro-Rheme'; that is, there is a point of departure for the message, but there is no body to the message.

As previously explained, 'hyper-Theme', a term coined by Daneš  for a Theme that is later repeated, is Martin's rebranding of the 'Topic Sentence' of writing pedagogy as linguistic theory. As linguistic theory, hyper-Theme is a function without a structure: there is no 'hyper-Rheme'; that is, there is a point of departure for the message, but there is no body to the message.

[2] To be clear, given the contrastive newness of last, and the fact that tone 3 alone misrepresents this statement as tentative, a more likely analysis of this tone group is

//3 ‸the / last one is the //1 distal / convoluted / tubule //

[3] To be clear, here the authors are merely describing how the lecturer moves while delivering this part of his lecture. Merely occupying a space before moving off does not highlight what is being said. And what is first said need not be a "macro-Theme". That is, no realisation relation has been established between "macro-Theme" and body location: a body location does not specify a "macro-Theme" and a "macro-Theme" does not specify a body location.

[4] As previously demonstrated, the relevant footfalls in Figure 6.6 coincide with the Focus of marked New information.

Problems With The Authors' Intonational Analysis

Ngo, Hood, Martin, Painter, Smith & Zappavigna (2022: 182):

In the unmarked case, salient syllables highlight content words (not grammatical ones) and assign a secondary degree of prominence to that information in the discourse. However, in (17) there are two marked instances where grammatical words are made salient: not in the second tone group and is in the third.

These marked choices give prominence to contrastive positions in the discourse (in this case, that which is and is not knowledge). In the first two tone groups the tonic syllables (in bold) carry tone 4 pitch contours. This falling-rising tone movement indicates pending meaning. The tone 1 of the third tone group signals completion.

Blogger Comments:

To be clear, with regard to TONE, it is tone 3 that serves this textual function (Halliday & Matthiessen 2014: 440), and it is likely that the speaker selected tone 3, not tone 4. Tone 4 would be unlikely here because it would realise 'reservation' in terms of KEY, which is inconsistent the proposition being enacted. The fall-rise of tone 4 signals 'seems certain (fall) but isn't (rise)'.

In terms of TONALITY and TONICITY, it is likely that the second tone group actually consists of two tone groups, with the first tonic on not, to mark the contrast as New information for the student audience.

Confusing Demarcation With Deixis

Ngo, Hood, Martin, Painter, Smith & Zappavigna (2022: 168-70):

Paralinguistically, a [virtual:semiosis] entity may be identified either retrospectively or prospectively through an unresolved embodied vector. In a number of instances in the data the selection [virtual:semiosis:retrospective] is realised through a gestural flick – a small, fleeting vertically directed vector expressed with an index finger or hand (body parts that facilitate speed of movement). The flick gesture synchronises with a silent beat (^) which marks a juncture (e.g. a phase or stage boundary) in the flow of meaning in a text. The deictic gesture identifies a preceding segment of text (a semiotic entity), one that bears a logical connection to the coming phase or stage of discourse. The subsequent text is frequently initiated with an internal connector such as so.

Example (5) shows one such instance from the data. … Following presentation of a phase of argument from the airline’s legal counsel, the plaintiff’s argument is introduced in (5). As the phonological transcription reveals, the vertical flick syncs with a silent beat (^) preceding the commencement of the last tone group, which begins with the internal connector so.

In (6) the first image captures the conclusion of Edmonds’s argument everything’s mucked up. Image 2 shows the vertical flick (circled), realised in sync with the culminative silent beat (^). It retrospectively identifies the preceding semiotic entity – in this case a stage of the storytelling in which both parties (British Airways and Edmonds) put their arguments to the court. The conclusion of that stage converges with the lecturer closing his eyes and dropping his head. In image 3 the lecturer reorients his body to his left in sync with the internal connector so as he commences a new stage of the lecture in which he discusses the logic of the preceding arguments.

Blogger Comments:

[1] To be clear, the timing of the gesture with a pause between a quote and a non-quote might be taken as evidence that the function of the gesture is demarcation (punctuating text) rather than deixis (pointing with respect to the speaker).

[2] To be clear, the authors provide no evidence in support of this claim. It would seem that the authors have given priority to the view 'from below' rather than the view 'from above': that is, since the gesture resembles pointing, it must have a deictic function, therefore it must refer back to the previous text.

Graduation: Force

Ngo, Hood, Martin, Painter, Smith & Zappavigna (2022: 35-6):

The most striking example of intensification in the hair colour phase occurs when the vlogger uses whole body language to enact her reaction to how dark her hair is. She throws her head back and leans back as her arms rise up – literally overwhelmed with emotion (82).

Blogger Comments:

This is recycled almost verbatim from Martin & Zappavigna (2019). Here are the comments from the review of Martin & Zappavigna (2019): Paralanguage "Converging With" GRADUATION: FORCE.

[1] To be clear, it is not that the whole body expresses the same meaning in this instance, but that the authors have not analysed the different meanings being made by the various gestures and postures, including the shift of gaze.

[2] To be clear, the intensification in this instance is of the Quality dark, which is ideational in function, and quite distinct from the speaker's hatred of the Quality, which is construed by the following clause.  That is, the intensification is a feature of the assessed, not of the assessing (e.g. I really hate it).   This is demonstrated by the fact that the arm gesture beats on the tonic so, the intensifier of dark.

In terms of Cléirigh's original model, the beating of the gesture on the tonic is linguistic body language ("sonovergent" paralanguage), highlighting so as the focus of contrastively New information, whereas any aspects of the body language expressing conscious states are instantiations of paralinguistic body language.  That is, contrary to the authors' claim, no aspects of this instance of body language can be identified as epilinguistic ("semovergent").

[3] The claim that this gestural configuration expresses 'being overwhelmed by the emotion of hate' — literally or figuratively — requires considerable justification, none of which is given.

[4] To be clear, [82] displays an (incomplete and) incorrect phonological analysis — the tonic  actually falls on so, not dark, the initial foot is omitted, and the pronoun I begins the following tone group (after a silent Ictus):

//1+ and it's / so dark //

Hand Shapes

Ngo, Hood, Martin, Painter, Smith & Zappavigna (2022: 32):

As noted earlier, for this paralinguistic sequence hand shape and motion are combined. In other cases hand shapes occur on their own. In the following sequence our vlogger concentrates on the size of the snack she has given her children, without setting the bowl in motion:

(70) //3 then they had a / snack I

(71) //4 gave them / each a / bowl - like a heaping / bowl

(72) //3 full of / Chex Mix and an

(73) //4 applesauce / squeeze and they //

Blogger Comments:

This is recycled almost verbatim from Martin & Zappavigna (2019). Here are the comments from the review of Martin & Zappavigna (2019): Gestures Realising Elements Rather Than Figures.

[1] To be clear, epilinguistic body language (rebranded here as 'semovergent paralanguage') is potentially expressed through the whole body, not just through handshapes and their movements.

[2] To be clear, the timing of these gestures functions as linguistic body language (rebranded here as sonovergent paralanguage'), since they beat with the rhythm of the speech, the first on the salient syllable hea-, the second on the tonic bowl, the focus of New information.

[3] To be clear, this demonstrates that these gestures realise elements rather than figures, the latter being what the authors claim to be analysing. These two very rapid gestures are made while the speaker utters the two words heaping and bowl, suggesting that they realise the semantic elements Quality (sense-measurement) and Thing (non-conscious material object) in parallel with the meaning realised in the wording.

[4] To be clear, this is not a sequence.  The two figures

• then they had a snack
• I gave them each a bowl like a heaping bowl full of Chex Mix and applesauce squeeze

are not structurally (logically) related into a sequence.  Any implicit relation between them is a cohesive (textual) relation between messages.

Moreover, the [four] tone groups presented as a sequence are further misanalysed for tonality [and tonicity].  [(71) actually comprises [two] tone groups, with tonic prominence [in (72)] on Mix, highlighting [it] as a Focus of New information.

The Phonological System Of Tonality

Ngo, Hood, Martin, Painter, Smith & Zappavigna (2022: 24):

The phonological system of TONALITY organises spoken language into waves of information called tone groups, with one salient syllable carrying this tone movement. Gestures may be coextensive with this periodic unit. In examples (57) and (58) the vlogger makes a sweeping right-to-left gesture referencing past time; the gestures unfold in sync with the temporal extent of the tone group.

Blogger Comments:

This is recycled verbatim from Martin & Zappavigna (2019). Here are the comments from the review of Martin & Zappavigna (2019): Blurring The Distinction Between Linguistic And Epilinguistic Body Language.

[1] To be clear, here the authors confuse the content plane with the expression plane.  The phonological system of TONALITY is concerned with the duration of the tone group, a phonological unit.  The duration of the tone group realises the duration of the information unit, a grammatical unit.  It is the information unit that constitutes the "wave of information", not the tone group.  This is not a new confusion on Martin's part; Martin (1992: 384) mistakes the system of INFORMATION for a phonological/graphological system.

[2] This is a bare assertion unsupported by evidence, and falsified by the vast majority of gestures that do not extend for the duration of a tone group.  In Cléirigh's model, it is not that gestures tend to be co-extensive with the tone group, but that, when they do, the extent of the gesture has the same function as the extent of a tone group, namely: the realisation of the extent of an information unit.

[3] To be clear, in Cléirigh's model, a gesture that realises the meaning 'past' is epilinguistic body language, not linguistic body language.  In terms of Martin's rebrandings of his source, this is 'semovergent paralanguage', not 'sonovergent paralanguage'.  Metafunctionally, the meaning is interpersonal as well as experiential, since it also means 'past' relative to the time of the speech event.

[4] To be clear, in Cléirigh's model, it is only this aspect of the gesture, its co-extension with a tone group, that constitutes linguistic body language (rebranded by Martin as 'sonovergent paralanguage').  Metafunctionally, the meaning is textual, demarcating a unit of Given and New information.