Academia.eduAcademia.edu

(Audio)visual labyrinths. Non-linear discourses in linear media

AI-generated Abstract

This paper discusses the transformation of linear media, particularly film and video, into non-linear discourses. It highlights how the structure of narrative in traditional cinema affects viewer reception and explores the impact of video technology on this dynamic, allowing for manipulative spectator engagement and contributing to a shift towards interactive culture. The author argues that video art and installations facilitate non-linear experiences, ultimately transforming how audiences interact with visual media.

(AUDIO)VISUAL LABYRINTHS NON-LINEAR DISCOURSES IN LlNEAR MEDIA Ryszard W. Kluszczyński I Let us begin our discussion by describing the area of our interest, as well as establishing the meanings of the concepts to be used throughout the analysis that follows. Our study concerns artistic visual and audio-visual phenomena that either employ time-structure (time-based arts), or use (audio)visual temporal forms as the elements of a complex structure of spatial arrangement (e.g. video installation, environment, multimedia event). The time structure of these phenomena is linear, which is a direct result of the substance of the medium. Linearity bears the features of the substance of the medium, meaning that it cannot be characterised by any stylistic, genre-related choice; instead, it constitutes an essential attribute ascribed to a certain field. Once we are capable of understanding that quality, we will embrace cinema and video art, which is perceived by same theoreticians (e.g. Gene Youngblood, 1970) as an expansion or extension of the film medium. The structure of the video tape is temporal, whereas installations are organised spatially and include visual or audio-visual temporal forms. The limitation of the analytic scope to visual and audio-visual media eliminates, despite their linear character, purely audible (sonic) media. Non-visual sonic structures might appear in the field of our analysis solely as the elements of complex, spatial audio-visual structures. II In order to define the meaning of the notion of “linearity”, let us say that the term applies to every dynamic process structure in which. 1. The arrangement of the elements is successive, while temporal perspective dominates the spatial architecture. The direction of this perspective, being 1 defined a priori, demarcates the temporal span of every work. The process structure gains linear character only when its components get connected in the compact wholeness. In film, this arrangement is usually controlled by the structure of the narrative discourse that endows the work with a certain cohesion. 2. The structure of the work dominates the structure of reception, which means that the unidirectional sequentiallity of the work is projected onto the experience of reception. The dichotomy of linearity is the main cause behind the double nature of its abandonment which can be realised through: 1. The distortion of a work's sequentiallity. Since the sequentiallity is usually controlled by narrative structure, the discourse of the narrative is the first factor to be distorted. The successive sequence could also be deconstructed by manipulative means that, while preserving the general outline of narrative horizon, enlarge the whole structure to such an extent that the linearity of reception is loosened. 2. Undermining of the domination of the work's structure over the structure of reception. Thus, the structure of the work surrenders sharpness, definiteness and durability and, as a result, opens an extended field of possible types of reception and interpretation, or a creative space of interaction. III. Strategies of film art that effect the transgression of linearity could be divided into three groups. The purposes of all these groups are: disturbing the narrative order, undermining the domination of storytelling over the remaining elements of film structure and releasing the image, restoring and granting its autonomy. The image treated in this way could be handled in different ways, which is the reason (and the criterion) for isolating those three groups of strategies mentioned. Subsequently, one group arranges the images in poetic structures, linking them together either with metaphoric relationships based on associations and antitheses (semantic links), or references to symbolic, mythical and archetypal meanings. The poetic film has been developing since the twenties (e.g. dadaist and surrealistoneiric cinema), assuming always newer forms. The second group substitutes syntactical connections linking particular film components (phases) by means of rhythmic relations, for rejected narrative relationships, employing parameters of time, dynamics and direction. This kind of approach is present in various kinds of what is widely understood as abstract cinema. "visual symphonies", kinetic films and cinema pur. 2 The third group of strategies creates films that break down and abandon the narrative structures, focusing the audience's reaction on ontological representation of the cinema, analysing film as a medium. The processes take place against the background of conceptual art. The phenomenon described was called "structural cinema". IV. Strategies that - contrary to the previous ones - aim at undermining the domination of the work's structure over the structure of the reception not only represent a mere attempt to destroy the narrative order or the plot structure, but also tend towards the abandonment of the objectivity of the film work. In miscellaneous forms of expanded cinema, the process is carried out by removing attributes of stability from a film work and replacing them with numerous forms of happening and performance activities, or by multiplying some concepts or elements (poly-vision, image division etc.) that, in consequence, lead to dissociation and partial avoidance of permanent control. The structure of the work can also be minimalized and set beyond the borderlines of the minimum of organisational structure that would have been capable of managing the process of reception. A further stage of linear transformation of cinema into a non-linear medium was stimulated mainly by the application of computer technologies that constituted prospects for interactive cinema. The transformation reaches its final stage in replacing the textual structure typical for linear cinema with hypertext, being a basis of non-linear interactive cinema. A certain type of interactive film that is gaining recognition in modern film practice utilises the CD-RDM medium for creating filmic images and games on computer screens. Another, more advanced variant, which is therefore still in its experimental stage, employs another medium -Virtual Reality (VR). VR enables users to experience a full immersion in a virtual interactive environment that provides real-time responses. In addition to this, the possibility of using the Internet computer network as a creative tool seems to be quite promising. Theoretically, it allows any given number of participants to take part in film events in an active and innovative way. An imaginable, even more advanced form of interactive cinema, employing all basic characteristics of cyberculture-real-time multimedia interactivity, globalism, interconnectivity -would inevitably lead to networked visual reality. Interactive cinema in all its manifestations goes beyond the main scope of our present discussion. We shall thus not be dealing with its detailed analysis. By 3 means of computer technology, the linear film medium became non-linear. The art of filmmaking gained the status of interactive art. However, it is impossible to determine (and I shall not be doing it here) whether it should still be called film art. Let us discuss instead the three afore mentioned groups of filmic strategies, i.e. ones that strive to transcend the limitations of linearity without fully discarding the linear media. At the end of the text. we shall try to analyse the non-linear aspects of video art. V. The paradigm of avant-garde film, shaped in the 1920's, was a direct consequence of experiments in visual arts, poetry and music. It was strongly opposed to the notion of narrative cinema, which was developed in the previous decade by film makers like David Wark Griffith. Narrative cinema, with its fast progress and inner stability, determined standards of linearity marked, among other things, by the logic or causal relationships, the coherence or represented world, psychology of characters etc. Avant-garde cinema rejected or broke down the principles or linear narrative discourse, replacing them with the aforementioned (see part III of this article) semantic and syntactic rules. If the structures of representational discourse and the world represented were distinguished from one another, we would be able to prove that, inasmuch as the breakdown of the former is possible within a very limited and incomplete range, decomposition and delinearisation of the latter could be much more advanced in comparison. The representational discourse, especially in formal cinema (poetic and abstract), does not have the ability to overcome the unidirectionality of progress; after successful (primary) decomposition ol narrative structure, the structure of intraelemental relations inevitably attains another, different form of durability and structural finiteness. In this dimension, non-linearity is principally more an intent (desire) than a realizable goal. On the level of the structure of the world represented we can observe a remarkable slackness of relations (which, of course, is an effect of the strategies of representational discourse adopted; ultimately, both levels are closely connected). The world represented can become (from the point of view of narrative logic) open, unmarked, full of internal ambiguities, inconsistencies or even contradictions which enable the receiver (or force her/him to perform the act of free interpretation and arbitrary substantiation. These are so-called poetic films. There are numerous examples of such structures. Let us consider, for example, "Un Chien andalou" (1928) by Louis Bunuel and Salvador Dali. Various sequences of "Un Chien andalou" are very loosely associated with each other The first part of the picture is largely detached from the following parts; the whole prologue has 4 been described as a meta-discoursive comment upon the new model of cinema, developed in the film (Williams, 1981). Parts that follow, although not fulfilling meta-discoursive functions directly, are similarly linked in a very unconstrained way. The most important qualities of the film world, which was created by means of the strategies used, include: - Ontological instability; its components are activated and disappear without any specific reasons. - Fluid identity of separate components; they mutate and interlace each other, creating heterogeneous, or hybrid entities. - Suspension of causal functions in relation to situations and events. - Undermining of logical laws, associations and motivations (the term logic. applies to the Aristotelian, dualistic system). Instead of the above mentioned elements, the work utilises free associative patterns, relations based on analogies, contradictions or contiguities. Distortion of temporal and spatial relationships. Weakening of their individual parameters. Forming of spatio-temporal sets characterised by variability of forms and internal relations. - Film reality as a universe ruled by paradoxical logic versus freedom of imagination as an underlying principle. - Construction of filmic meanings (enigmatic and multidimensional) that penetrate deep layers of psyche and actualize mythical and archetypal patterns. (Kluszczyński, 1990) There are many films that assume the structural shape of "Un Chien andalou". Some of them like "Meshes of the Afternoon" (1943) by Maya Deren. replicate the modal quite precisely. Other films, like "Przygoda człowieka poczciwego" (Adventure of Good Citizen, 1937) by Franciska and Stefan Themerson, behave more arbitrarily. Their variety comprises the whole spectrum of poetic cinema. Maya Deren, mentioned above, juxtaposed the vertical structure of the poetic film with the horizontal structure of narrative cinema. Vertical structures expand. both formally and semantically, particular distinguishable elements of the whole structure and their relationships, breaking up the well-kept linearity of the filmic discourse. Vertical cinema that overcomes the linear convention should be considered as Deren's own version of poetic cinema. In this context. we should also mention film theory and practice as formulated by Stan Brakhage, who once confessed: "like Jean Cocteau. I was a poet who also made films" (Brakhage, 1982: 113). In his mature period (starting with "Anticipation of the Night. 1958), Brakhage attempted to unite three spheres associated with the filmic process: the world of pro-film phenomena, the sphere of cinematic technology and the artist's psycho-physical subjectivity. Aided by 5 conceptual supporters like Charles Olson with his notion of "objectism", Brakhage tried to conquer the claims of the Self, intending to confront the subjective Self and Nature (James, 1989: 40-44). In this way. Brakhage wanted to liberate the medium, depriving it of every possible convention perceived and rejected by him as a form of the mind’s (self’s) control over filmic expression. He eliminated not only narrative discourse, but also other principles, anchoring the perception of the work to the objectivised language of cinema. Thus, in a certain way, the element of linear sequentiallity also became redundant. Out of necessity, film as a medium tended to be a linear. ordered and fixed series of images. However, the perception itself was devoid of order and organisation. The temporal progress of film was the only element that enforced the direction of the reception. Brakhage's concept of "untutored eye" demanded that the spectator should, using imagination and sensibility, structuralise the personal experience of the film. VI. Another group of strategies intended to deprive the film of its traditional linearity was the active force behind the abstract film. Contrary to poetic film, with its dominating semantic constructions. the abstract film emphasises the presence of syntactic elements. In abstract films, cohesion is the common product of organised material-film substance and the rules of construction (structuring of substance). In all described processes, movement is one of the more important factors: movement within image (properties of substance). movement of image (function of camera) and movement of images (function of editing). The dynamic structure of the film, with its musical organisation of themes, their transmutations and reprises, sets in motion (and refers to) non-narrative mechanisms of reception. In the case of such films, retention and protention processes, important components of perception, have decidedly structural functions; that means that the recipient memorises (or anticipates) rhythmic structures, choruses and quasi-melodic transformations. not narrative plots, characters. histories or any transformations of the represented world. References to musical structures are probably very important for delinearization processes in abstract film. Even though, as in poetic films, the structure of abstract film discourse gains a finiteness and durability of shape that the recipient is bound to perceive, the character of the work gives the perception sui generis non-linear character. Sequentiallity is accompanied by the necessity for retrograde (retentive) references and the grasping of simultaneous visual (or audio-visual). The complexity of this perception is so substantial that it ceases to be purely linear. In the area of filmic-musical references, several notions were pushing the process of delinearization much further than abstract cinema was. One such idea was 6 formulated in 1942 by the Polish musician and composer Onufry Bronisław Kopczyński. Writing on abstract film, he advised a change in the methods of its presentation. According to Kopczyński, the completed film print should be treated as the “score”, and the film itself should be “performed”, and not merely shown or screened. Thus, Kopczyński effectively extended the field of creative film work. The stage of artistic treatment involves not only the processes of realisation (shooting, editing etc.), but also the presentation of the work. In this method, the film's screening becomes its interpretation, the film projector gains the status of a creative instrument, the operator turns into an artist (basically, it means that an artist takes over and transforms the projectionist's function). Interpretative performance of the film deprives its structure of durability and finiteness, in a certain sense calling its linearity into question, and drawing it closer to interactive cinema. Accordingly, every presentation is unique. Still, an artist's function is active in this process, contrary to the function of the recipient. The notion of film score interpreted by an artist using a projector/instrument formulated by Kopczyński, foretells expanded cinema's later developments (Kluszczyński, 1993a). VII. The third group of strategies is interlinked, creating the model of structural film. Works that represent this direction do not focus our attention on formal order; rather, they emphasize the nature of the medium. Structural cinema uncovers the ontological structure of film; the meshwork of basic relationships which guarantee the existence and shape of every single film phenomenon. During the projection, the structure of the filmic medium assumes the shape of an intellectual correlate of the presented film, the final product of the abstraction process, reduction uncovering the ontological fundaments of the film phenomenon. In structural film, time and space become destabilised. The tricks employed do not allow them to develop fully and permanently, utilising constant parameters. Fragmentary pieces of narration or single events, atomised beyond the narrative systems, appear in structural film as a spatial function only. Loops - continuous returns of certain images - turn the linear successivity into multidimensional penetration and manifold exploration of known places. "Tom, Tom the Piper's Son. (1969) by Ken Jacobs is an exquisite example of the spiral construction in structural film, a neverending and looped peregrination through the space of a film by Bill Bitzer (1905). The travel takes place in a completely different dimension, as if moving into the depths of the filmic matter. Structural film is deprived of all dimensions of the linear element to a greater extent than formal cinema (poetic and abstract). In principle, expanded cinema is very close to structural film. Breaking the conventional framework of the classical cinema, it undermines its medial determinants. Often it assumes the shape of a happening or performance ("Zen for 7 Film. by Nam June Paik or "Film #4" by Takehisa Kosugi),letting the audience navigate freely through the spatial, real dimensions of the work. In some cases its form is more traditional, e.g. multi-screen projection. Zbigniew Rybczyński is one of the artists deserving highest merit for delinearization of the cinema. His film "Nowa książka" ("New Book"), awarded prizes at several festivals, is another important stage in the development of nonlinear film poetics. The image in “New Book” has been divided into nine parts. The film's action takes place simultaneously in all the sections (in each one of them one can see the results of additional interference, e.g. manipulation of the speed, fluency and direction of motion), while the events are so linked in time and space that, as the action goes on, they move from one portion of the image to another. Thus, the spectator has to watch at once all the parts of the screen and the relationships between them simultaneously and collaterally, that is to say, he has to observe the successiveness of the transformations. This device results in the extreme spatialisation of time and simultaneously a temporalisation of space, all within the same process. In his earlier films Rybczyński already liked to manipulate time and space (a multiple exposure, frame for frame shooting). This time, however, he applied a new device which, apart from making the film's structure coherent through the retention of the numerous complicated motives, was very effective in breaking up linear narrative discourse. "Tango" - the most famous of all films by Rybczyński - infringes the linear rules of the film medium in another way. While in "New Book" we are faced with a segmentation of the image, in "Tango" all characters are put together in the same time space, but separated. Crowned with an Oscar, this legendary film has be en extensively described. It consisted of twenty-two shots of people engaged in various activities (duration of 12 to 36 seconds). Each of these shots is ed[ed into a loop, which means that the characters repeatedly perform the same acts. As time goes on, the number of people simultaneously present in the frame grows. At the culmination, all of them are there. Then the screen gradually empties, to return a the end to the opening state. In order to realise his concept Rybczyński had to shoot all the characters successively (the lines drawn up on the floor made it possible for them not to screen one another), to reduce the fluency of motion to some selected phases, to make about s ix thousand masks, to shoot the background separately to produce counter-masks and by means of them one more overall mask, this time as long as the whole film itself, and to trace an outline of the action and the succession of the final, while using the optical printer and the prepared film material to create a synthesis, a materialisation of his vision (till then only existing in his imagination). In the film "Take Five" (1972) the characters broke up linearity of the medium by simultaneous appearance owing to the overlapping images. In the "New Book" the simultaneity of the numerous motives was achieved by the partition of the image (screen) into sections and the parallel presentation of these. In "Tango" the characters appeared again in the same time-space and the same picture, but, being 8 separated, were deprived of any contact to one another. The distance (and differences) between these films demonstrates not only the evolution of Rybczyński's art as it goes from familiar techniques to dazzling innovations; it also shows the process of departing from cinema and approaching video. The image in "Tango" seems no longer to look like the image in film with the latter's texture, light values and references to the outside world of matter. Instead, it gets increasingly closer to the world of video, formed by the blue box and the techniques of digital processing of the image. According to Rybczyński, there is nothing more to be discovered in the cinema (Kluszczyński, 19931. VIII. Video art seems to deepen the process of delinearisation of (audio)visual structure to a greater extent than the cinema does. The scope of innovations introduced by video is considerably larger w hen we reflect on the process of reception than w hen we consider the issues of structure and poetics of film and video work. The invention of the video tape has made it possible for films to be perceived in private surroundings, at home, in circumstances quite different from classical cinema reception and from standard television watching (a film as part of a television program). The cinema show (a spectacle) has been replaced by a process which I would like to call film reading (lecture). The situation of the spectator in a cinema has been compared to the condition of a daydreaming person. It is from this, among other things, that the significance of reflection on identification-projection processes, characteristic of cinema - originated. In home surroundings they have been replaced by reception in a state of diffused attention, which has already been described by Walter Benjamin. Such a reception was also facilitated by !he replacement of screen projection of complete static pictures, characteristic of a cinematic show (pictures superimposed upon one another and activated in the process of perception) by light emission, typical of television and video, where the appearance of a picture is conditioned by the successive occurrence of its constituent points (pixels). As a result, the awareness of a spectator watching a film on a television screen is much less dominated by the film structure, the world of film and the magic of the participation in this world than is the case in cinema. The fact that video-taped film can be manipulated in various ways, such as by pausing, fast forwarding, slow motion and reversing, helps to free the spectator from !he power of the film structure. The viewer is in a position to influence the course of his/her experience of a film. Thus the structure of the film being watched on the video tape loses its ultimate and intact nature (although the ultimate nature of the structure given to the film is inherent in its concept). This feature of video is perhaps the most important difference between video and cinema. From this 9 perspective, video art turns out to be another stage in the process of transformation leading towards non-linear interactive culture. Film reception, as I have already mentioned, has been transformed - thanks to video - into film reading, a linear, yet manipulable, multifunctional process of perceiving, comprehending and experiencing. Video installations effectively remove !he linear elements from video art. They enable the recipient to navigate in real space, something which applies also to particular manifestations of expanded cinema. Thus, they create one of the ways in which linear media culture can turn into non-linear interactive cyberculture. Non-linearity, which in video appeared in a "rudimentary" form (or as just the announcement of the coming of actual interactivity) only as a possibility for receptive behavior motivated not by the structure of the work, but by the needs of the viewer, can assume a fully-fiedged form in an interactive computer art. This means that non-linearity and interactivity are becoming the internal principles of the work, and that the viewer - if he/she wishes to substantiate it - has to start a game which will result in the shaping of the object of his/her perception. Nonlinear interactivity is becoming one of the most important features of contemporary civilisation and culture (Kluszczyński, 1995) Bibliography: Brakhage, S 119821 Scrapbook Collected Writings 1964-80, New Paltz, New York James, D.E.119891 Allegories of Cinema. American Film in the Sixties, Princeton University Press, Princeton. New Jersey. Kluszczyński, RW (1990) Film -sztuka Wielkiej Awangardy (Film. The Art of the Great Avant-Garde, PWN. Łódź-Warsaw. Kluszczyński, R.W. (1993) Absolute Against Casualty Zbigniew Rybczyński's Cinema 11972-19801. "Exit. New Art in Poland", Quarterly No.3115). Kluszczyński, R.W.11993a) Film. Music, language. "Exit New Art in Poland". Quarterly No.4(16). Kluszczyński, R.W.119951 Audio-Visual Culture in the Face of the Interactive Challenge in. Media Art Festival WRD 95 Catalogue, ed. P. Krajewski, D. Celejewska, Wroclaw Williams, L. (1981 ) Figures of Desire. A Theory and Analysis of Surrealist Film, Illinois Youngblood, G (1970). Expanded Cinema, New York. RYSZARD W. KLUSZCZYÑSKI Media art scholar, critic and curator Studied literature, aesthetics, theatre and film at the University of Łódź. MA in 1976. Postgraduate studies in French 11982-841 and English 119871. PhD. in 1987; Since 1987 Professor at the University of Łódź, Film and Media Department: 10 Since 1990 Media Art Curator at the Centre for Contemporary Art -Ujazdowski Castle, Warsaw; Since 1993 Professor at the Institute for European Studies, Łódź; Since 1993 Contributing Editor (Media art section). Quarterly "Art Magazine"; Since 1995 Professor at the University of Łódź, History of Art Department: published and edited about ten books on theory and history of the avant-garde, especially film, video and multimedia and more than 150 articles on media art and experimental artistic culture; lectures and participation in international symposiums and panels. In 1988 he founded the Polish Video Art Data Bank (now: Media Nomad), a private non profit organisation for media culture. 11