Lec3-CompilerConstruction 2

Compiler
Construction
Lecture 3
1
Topics Covered in
Lecture 2
2
Source Code
Lexical Analyzer
Syntax Analyzer
Symbol Semantic Analyzer

Error
Table
Handler
Manager
Intermediate Code Generator
Code Optimizer
Code Generator
3
Object Code
Lexical Analyzer
(Part One)
4
Lexical Analysis
INPUT: sequence of characters
OUTPUT: sequence of tokens
Next_char() Next_token()
Input
Scanner Parser
character token
Symbol
Table
•A lexical analyzer is generally a subroutine

of parser
•A symbol table is a data structure
containing a record of each identifier along
with its attributes 5
Role of Lexical Analyzer
1. Removal of white space
2. Removal of comments
3. Recognizes constants
4. Recognizes Keywords
5. Recognizes identifiers
6. Correlates error messages with the
source program
6
• By white space we mean
– Blanks
– Tabs
– New lines
• Why ?
– White space is generally used for
formatting source code.
A = B + C Equals A=B+C
7
Learn by Example
// This is beginning of my code
int A;
int B = 2;
int C = 33;
A = B + C;
/* This is
end of
my code
*/
8
Learn by Doing
int A ;
A = A
*
A
;
/* This is
end of
my code
*/
9
Why ?
– Comments are user-added strings which
do not contribute to the source code
Example in Java
Means nothing to the program
int A;
int B = 2;
int C = 33;
A = B + C;
/* This is
end of Means nothing to the program
my code
*/
10
3. Recognizes
constants/numbers
• How is recognition done?
– If the source code contains a stream of digits
coming together, it shall be recognized as a
constant.
Example in Java
int A;
int B = 2 ;
int C = 33 ;
A = B + C;
/* This is
end of
my code
*/
11
4. Recognizes keywords
• Keywords in C and Java
– If , else , for, while, do , return etc

– By comparing the combination of letters with/without
digits in source code with keywords pre defined in the
grammar of the programming language
Considered a keyword if character sequence
– Example in Java 1. I
int A; 2. N
3. T
int B = 2 ;
int C = 33 ;
Considered a keyword if character sequence
If ( B < C )
1. I 2. F
A = B + C;
else Considered a keyword if character sequence
A= C-B 1. E 2. L 3.S 4.E
12
• What are identifiers ?
– Names of variables, functions, arrays , etc

– If the combination of letters with/without digits in source code is not a keyword,
then compiler considers it as an identifier.
• Where is identifier stored ?
– When an identifier is detected, it is entered into the symbol table
Example in Java
int A;
int B2 = 2 ;
int C4R = 33 ;
A = B + C;
/* This is
end of
my code
*/
13
6. Correlates error messages with
the source program
• How ?
– Keeps track of the number of new line characters seen
in the source code
– Tells the line number when an error message is to be
generated. Error Message at line 1
• Example in Java
1. This is beginning of my code
2. int A;
3. int B2 = 2 ;
4. int C4R = 33 ;
5. A = B + C;
6. /* This is
7. end of
8. my code
9. */
14
Errors generated by Lexical
Analyzer
1. Illegal symbols
• =>
2. Illegal identifiers
• 2ab
3. Un terminated comments
• /* This is beginning of my code
15
• Learn by example
– // Beginning of Code
– int a char } switch b[2] =;
– // end of code
• No error generated
• Why ?
• It is the job of syntax analyzer

16
Terminologies
• Token
– A classification for a common set of strings
– Examples:
Identifier, Integer, Float, LeftParen
• Lexeme
– Actual sequence of characters that matches a pattern and has
a given Token class.
– Examples:
Identifier: Name, Data, x
Integer: 345, 2, 0, 629
• Pattern
– The rules that characterize the set of strings for a token
– Example:
Integer: A digit followed or not followed by digits
Identifier: A character followed or not followed by characters or
digits
17
18
Learn by Example:
Input string: size := r * 32 + c
Identify the <token ,lexeme> pairs
1. <id, size>
2. <assign, :=>
3. <id, r>
4. <arith_symbol, *>
5. <integer, 32>
6. <arith_symbol, +>
7. <id, c>
19
Learn by Doing
Input string:
position = initial + rate * 60
20
Lets Revise!
21
Lexical Analysis
Next_char()
Next_token()
Input
Scanner Parser
character token
Symbol
Table
22
Role of Lexical Analyzer
6. Correlates error messages with the
source program
23
Terminologies
• Token
–Identifier, Integer, Float, LeftParen
• Lexeme
– Identifier: Name, Data, x
Integer: 345, 2, 0, 629
Pattern
– Example:
Integer: A digit followed or not followed by
digits
Identifier: A character followed or not followed
by characters or digits
24
Homework
1. For ( int x= 0; x<=5; x++)
2. B= (( c + a) * d ) / f
3. While ( a < 5 )
a= a+1
4. Char MyCourse[5];
5. if ( a< b)
a=a*a;
else
b=b*b;
25
Assignment-1
Write a program in C++ or Java that reads a
source file and performs the followings
operations:
Due Date: 5th October, 2010
26

Lec3-CompilerConstruction 2

Uploaded by

Copyright:

Available Formats

Lec3-CompilerConstruction 2

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Lec3-CompilerConstruction 2

Uploaded by

Copyright:

Available Formats

Compiler

Symbol Semantic Analyzer

•A lexical analyzer is generally a subroutine

• How is recognition done?

• How is recognition done?

• It is the job of syntax analyzer

Identify the <token ,lexeme> pairs

You might also like