01 Introduction Problems
01 Introduction Problems
01 Introduction Problems
Programming Assignment 1:
Introduction
Revision: December 30, 2016
Introduction
Welcome to your first programming assignment of the Algorithmic Toolbox class! It consists of seven algo-
rithmic problems. The first three problems require you just to implement carefully the algorithms covered
in the lectures. The remaining four problems will require you to first design an algorithm and then to im-
plement it. For all the problems, we provide starter solutions in C++, Java, and Python3. These solutions
implement straightforward naive algorithms that usually work only for small inputs. To verify this, you may
want to submit these solutions to the grader. This will usually give you a time limit exceeded message
for Python starter files and either time limit exceeded or wrong answer message for C++ and Java
solutions (the reason for wrong answer being an integer overflow issue). Your goal is to replace a naive algo-
rithm with an efficient one. In particular, you may want to use the naive implementation for stress testing
your efficient implementation.
In this programming assignment, the grader will show you the input data if your solution fails on any
of the tests. This is done to help you to get used to the algorithmic problems in general and get some
experience debugging your programs while knowing exactly on which tests they fail. However, for all the
following programming assignments, the grader will show the input data only in case your solution fails on
one of the first few tests (please review the questions 9.4 and 9.5 in the FAQ section for a more detailed
explanation of this behavior of the grader).
1
Learning Outcomes
Upon completing this programming assignment you will be able to:
1. See the huge difference between a slow algorithm and a fast one.
2. Play with examples where knowing something interesting about a problem helps to design an algorithm
that is much faster than a naive one.
3. Implement solutions that work much more faster than straightforward solutions for the following com-
putational problems:
5. Practice implementing, testing, and debugging your solution. In particular, you will find out how in
practice, when you implement an algorithm, you bump into unexpected questions and problems not
covered by the general description of the algorithm. You will also check your understanding of the
algorithm itself and most probably see that there are some aspects you did not think of before you
had to actually implement it. You will overcome all those complexities, implement the algorithms, test
them, debug, and submit to the system. Remember the advice (link) we gave you in the first module
about testing your programs and feel free to return to those videos or parts of them again while working
on your assignment. In the end of this document you will find also general recommendations on solving
algorithmic problems.
2
Contents
1 Problem: Small Fibonacci Number 4
3
1 Problem: Small Fibonacci Number
Problem Introduction
Recall the definition of Fibonacci sequence: 0 = 0, 1 = 1, and = 1 + 2 for
2. Your goal in this problem is to implement an efficient algorithm for computing
Fibonacci numbers. The starter files for this problem contain an implementation of
the following naive recursive algorithm for computing Fibonacci numbers in C++,
Java, and Python3:
Fibonacci():
if 1:
return
return Fibonacci( 1) + Fibonacci( 2)
Try compiling and running a starter solution on your machine. You will see that
computing, say, 40 already takes noticeable time.
Another way to appreciate the dramatic difference between an exponential time algo-
rithm and a polynomial time algorithm is to use the following visualization by David
Galles: http://www.cs.usfca.edu/~galles/visualization/DPFib.html. Try com-
puting 20 by a recursive algorithm by entering 20 and pressing the Fibonacci Re-
cursive button. You will see an endless number of recursive calls. Now, press Skip
Forward to stop the current algorithm and call the iterative algorithm by pressing
Fibonacci Table. This will compute 20 very quickly. (Note that the visualization
uses a slightly different definition of Fibonacci numbers: 0 = 1 instead of 0 = 0.
This of course has almost no influence on the running time.)
Problem Description
Task. Given an integer , find the th Fibonacci number .
Input Format. The input consists of a single integer .
Constraints. 0 45.
Output Format. Output .
Time Limits.
language C C++ Java Python C# Haskell JavaScript Ruby Scala
time (sec) 1 1 1.5 5 1.5 2 5 5 3
4
Sample 2.
Input:
10
Output:
55
Explanation:
10 = 55.
Starter Files
The starter files for this problem contain an implementation of a naive algorithm for the problem in C++,
Java, and Python3. For these programming languages, your goal is to replace the naive algorithm with an
efficient one. For other programming languages, you need to implement a solution from scratch. Filename:
fibonacci
Need Help?
Ask a question or see the questions asked by other learners at this forum thread.
5
2 Problem: Last Digit of a Large Fibonacci Number
Problem Introduction
Your goal in this problem is to find the last digit of -th Fibonacci number. Recall that Fibonacci numbers
grow exponentially fast. For example,
200 = 280 571 172 992 510 140 037 611 932 413 038 677 189 525 .
Problem Description
Task. Given an integer , find the last digit of the th Fibonacci number (that is, mod 10).
Input Format. The input consists of a single integer .
Constraints. 0 107 .
Sample 1.
Input:
3
Output:
2
Explanation:
3 = 2.
6
Sample 2.
Input:
331
Output:
9
Explanation:
331 = 668 996 615 388 005 031 531 000 081 241 745 415 306 766 517 246 774 551 964 595 292 186 469.
Sample 3.
Input:
327305
Output:
5
Explanation:
327305 does not fit into one line of this pdf, but its last digit is equal to 5.
Starter Files
The starter files for this problem contain an implementation of a naive algorithm for the problem in C++,
Java, and Python3. For these programming languages, your goal is to replace the naive algorithm with an
efficient one. For other programming languages, you need to implement a solution from scratch. Filename:
fibonacci_last_digit
Need Help?
Ask a question or see the questions asked by other learners at this forum thread.
7
3 Problem: Greatest Common Divisor
Problem Introduction
The greatest common divisor GCD(, ) of two non-negative integers and
GCD(1344, 217)
(which are not both equal to 0) is the greatest integer that divides both and .
Your goal in this problem is to implement the Euclidean algorithm for computing = GCD(217, 42)
the greatest common divisor. = GCD(42, 7)
Efficient algorithm for computing the greatest common divisor is an important = GCD(7, 0)
basic primitive of commonly used cryptographic algorithms like RSA.
=7
Problem Description
Task. Given two integers and , find their greatest common divisor.
Input Format. The two integers , are given in the same line separated by space.
Constraints. 1 , 2 109 .
Output Format. Output GCD(, ).
Time Limits.
language C C++ Java Python C# Haskell JavaScript Ruby Scala
time (sec) 1 1 1.5 5 1.5 2 5 5 3
Starter Files
The starter files for this problem contain an implementation of a naive algorithm for the problem in C++,
Java, and Python3. For these programming languages, your goal is to replace the naive algorithm with an
efficient one. For other programming languages, you need to implement a solution from scratch. Filename:
gcd
What To Do
To solve this problem, it is enough to implement carefully the corresponding algorithm covered in the lectures.
8
Need Help?
Ask a question or see the questions asked by other learners at this forum thread.
9
4 Problem: Least Common Multiple
Problem Introduction
The least common multiple of two positive integers and is the least positive
integer that is divisible by both and .
Problem Description
Task. Given two integers and , find their least common multiple.
Input Format. The two integers and are given in the same line separated by space.
Constraints. 1 , 2 109 .
Output Format. Output the least common multiple of and .
Time Limits.
language C C++ Java Python C# Haskell JavaScript Ruby Scala
time (sec) 1 1 1.5 5 1.5 2 5 5 3
Starter Files
The starter files for this problem contain an implementation of a naive algorithm for the problem in C++,
Java, and Python3. For these programming languages, your goal is to replace the naive algorithm with an
efficient one. For other programming languages, you need to implement a solution from scratch. Filename:
lcm
10
What To Do
Play with small datasets to find out how the least common multiple LCM(, ) is related to the greatest
common divisor GCD(, ). Do you see? For any two positive integers and , LCM(, ) GCD(, ) = .
Prove this property and implement an algorithm for computing the least common multiple using your solution
for the greatest common divisor.
Need Help?
Ask a question or see the questions asked by other learners at this forum thread.
11
5 Advanced Problem: Huge Fibonacci Number modulo m
We strongly recommend you start solving advanced problems only when you are done with the basic problems
(for some advanced problems, algorithms are not covered in the video lectures and require additional ideas
to be solved; for some other advanced problems, algorithms are covered in the lectures, but implementing
them is a more challenging task than for other problems).
Problem Introduction
In this problem, your goal is to compute modulo , where may be really huge: up to 1018 . For such
values of , an algorithm looping for iterations will not fit into one second for sure. Therefore we need to
avoid such a loop.
To get an idea how to solve this problem without going through all for from 0 to , lets see what
happens when is small say, = 2 or = 3.
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
0 1 1 2 3 5 8 13 21 34 55 89 144 233 377 610
mod 2 0 1 1 0 1 1 0 1 1 0 1 1 0 1 1 0
mod 3 0 1 1 2 0 2 2 1 0 1 1 2 0 2 2 1
Take a detailed look at this table. Do you see? Both these sequences are periodic! For = 2, the period
is 011 and has length 3, while for = 3 the period is 01120221 and has length 8. Therefore, to compute,
say, 2015 mod 3 we just need to find the remainder of 2015 when divided by 8. Since 2015 = 251 8 + 7, we
conclude that 2015 mod 3 = 7 mod 3 = 1.
This is true in general: for any integer 2, the sequence mod is periodic. The period always
starts with 01 and is known as Pisano period.
Problem Description
Task. Given two integers and , output mod (that is, the remainder of when divided by ).
Input Format. The input consists of two integers and given on the same line (separated by a space).
12
Sample 2.
Input:
239 1000
Output:
161
Explanation:
239 mod 1 000 = 39 679 027 332 006 820 581 608 740 953 902 289 877 834 488 152 161 (mod 1 000) = 161.
Sample 3.
Input:
2816213588 30524
Output:
10249
Explanation:
2 816 213 588 does not fit into one page of this file, but 2 816 213 588 mod 30 524 = 10 249.
Starter Files
The starter files for this problem contain an implementation of a naive algorithm for the problem in C++,
Java, and Python3. For these programming languages, your goal is to replace the naive algorithm with an
efficient one. For other programming languages, you need to implement a solution from scratch. Filename:
fibonacci_huge
Need Help?
Ask a question or see the questions asked by other learners at this forum thread.
13
6 Advanced Problem: Sum of Fibonacci Numbers
We strongly recommend you start solving advanced problems only when you are done with the basic problems
(for some advanced problems, algorithms are not covered in the video lectures and require additional ideas
to be solved; for some other advanced problems, algorithms are covered in the lectures, but implementing
them is a more challenging task than for other problems).
Problem Introduction
The goal in this problem is to find the last digit of a sum of the first Fibonacci numbers.
Problem Description
Task. Given an integer , find the last digit of the sum 0 + 1 + + .
Input Format. The input consists of a single integer .
Constraints. 0 1014 .
Output Format. Output the last digit of 0 + 1 + + .
Time Limits.
language C C++ Java Python C# Haskell JavaScript Ruby Scala
time (sec) 1 1 1.5 5 1.5 2 5 5 3
Starter Files
The starter files for this problem contain an implementation of a naive algorithm for the problem in C++,
Java, and Python3. For these programming languages, your goal is to replace the naive algorithm with an
efficient one. For other programming languages, you need to implement a solution from scratch. Filename:
fibonacci_sum_last_digit
What To Do
Instead of computing this sum in a loop, try to come up with a formula for 0 + 1 + 2 + + . For
this, play with small values of . Then, use a solution for the previous problem.
14
Need Help?
Ask a question or see the questions asked by other learners at this forum thread.
15
7 Advanced Problem: Partial Sum of Fibonacci Numbers
We strongly recommend you start solving advanced problems only when you are done with the basic problems
(for some advanced problems, algorithms are not covered in the video lectures and require additional ideas
to be solved; for some other advanced problems, algorithms are covered in the lectures, but implementing
them is a more challenging task than for other problems).
Problem Introduction
Now, we would like to find the last digit of a partial sum of Fibonacci numbers: + +1 + + .
Problem Description
Task. Given two non-negative integers and , where , find the last digit of the sum + +1 +
+ .
Input Format. The input consists of two non-negative integers and separated by a space.
Constraints. 0 1018 .
Sample 1.
Input:
37
Output:
1
Explanation:
3 + 4 + 5 + 6 + 7 = 2 + 3 + 5 + 8 + 13 = 31.
Sample 2.
Input:
10 10
Output:
5
Explanation:
10 = 55.
Sample 3.
Input:
10 200
Output:
2
Explanation:
10 + 11 + + 200 = 734 544 867 157 818 093 234 908 902 110 449 296 423 262
16
Starter Files
The starter files for this problem contain an implementation of a naive algorithm for the problem in C++,
Java, and Python3. For these programming languages, your goal is to replace the naive algorithm with an
efficient one. For other programming languages, you need to implement a solution from scratch. Filename:
fibonacci_partial_sum
What To Do
Use a solution for the previous problem to solve this problem.
Need Help?
Ask a question or see the questions asked by other learners at this forum thread.
17
8 General Instructions and Recommendations on Solving Algorith-
mic Problems
Your main goal in an algorithmic problem is to implement a program that solves a given computational
problem in just few seconds even on massive datasets. Your program should read a dataset from the standard
input and write an answer to the standard output.
Below we provide general instructions and recommendations on solving such problems. Before reading
them, go through readings and screencasts in the first module that show a step by step process of solving
two algorithmic problems: link.
18
same way on your machine and on the testing machine (note that a buggy program may behave differently
when compiled by different compilers, or even by the same compiler with different flags).
If your C/C++ compiler does not recognize -std=c++14 flag, try replacing it with -std=c++0x flag
or compiling without this flag at all (all starter solutions can be compiled without it). On Linux
and MacOS, you most probably have the required compiler. On Windows, you may use your favorite
compiler or install, e.g., cygwin.
Python 2 (CPython 2.7). File extensions: .py2 or .py (a file ending in .py needs to have a first line
which is a comment containing python2). No flags:
python2
Python 3 (CPython 3.4). File extensions: .py3 or .py (a file ending in .py needs to have a first line
which is a comment containing python3). No flags:
python3
19
8.5 Testing Your Program
When your program is ready, you start testing it. It makes sense to start with small datasets (for example,
sample tests provided in the problem description). Ensure that your program produces a correct result.
You then proceed to checking how long does it take your program to process a massive dataset. For
this, it makes sense to implement your algorithm as a function like solve(dataset) and then implement an
additional procedure generate() that produces a large dataset. For example, if an input to a problem is a
sequence of integers of length 1 105 , then generate a sequence of length exactly 105 , pass it to your
solve() function, and ensure that the program outputs the result quickly.
Also, check the boundary values. Ensure that your program processes correctly sequences of size =
1, 2, 105 . If a sequence of integers from 0 to, say, 106 is given as an input, check how your program behaves
when it is given a sequence 0, 0, . . . , 0 or a sequence 106 , 106 , . . . , 106 . Check also on randomly generated
data. For each such test check that you program produces a correct result (or at least a reasonably looking
result).
In the end, we encourage you to stress test your program to make sure it passes in the system at the first
attempt. See the readings and screencasts from the first week to learn about testing and stress testing: link.
20
9 Frequently Asked Questions
9.1 I submit the program, but nothing happens. Why?
You need to create submission and upload the file with your solution in one of the programming languages C,
C++, Java, or Python (see Subsections 8.3 and 8.4). Make sure that after uploading the file with your solution
you press on the blue Submit button in the bottom. After that, the grading starts, and the submission
being graded is enclosed in an orange rectangle. After the testing is finished, the rectangle disappears, and
the results of the testing of all problems is shown to you.
9.2 I submit the solution only for one problem, but all the problems in the
assignment are graded. Why?
Each time you submit any solution, the last uploaded solution for each problem is tested. Dont worry: this
doesnt affect your score even if the submissions for the other problems are wrong. As soon as you pass the
sufficient number of problems in the assignment (see in the pdf with instructions), you pass the assignment.
After that, you can improve your result if you successfully pass more problems from the assignment. We
recommend working on one problem at a time, checking whether your solution for any given problem passes
in the system as soon as you are confident in it. However, it is better to test it first, please refer to the
reading about stress testing: link.
9.3 What are the possible grading outcomes, and how to read them?
Your solution may either pass or not. To pass, it must work without crashing and return the correct answers
on all the test cases we prepared for you, and do so under the time limit and memory limit constraints
specified in the problem statement. If your solution passes, you get the corresponding feedback "Good job!"
and get a point for the problem. If your solution fails, it can be because it crashes, returns wrong answer,
works for too long or uses too much memory for some test case. The feedback will contain the number of
the test case on which your solution fails and the total number of test cases in the system. The tests for the
problem are numbered from 1 to the total number of test cases for the problem, and the program is always
tested on all the tests in the order from the test number 1 to the test with the biggest number.
Here are the possible outcomes:
Good job! Hurrah! Your solution passed, and you get a point!
Wrong answer. Your solution has output incorrect answer for some test case. If it is a sample test case from
the problem statement, or if you are solving Programming Assignment 1, you will also see the input
data, the output of your program and the correct answer. Otherwise, you wont know the input, the
output, and the correct answer. Check that you consider all the cases correctly, avoid integer overflow,
output the required white space, output the floating point numbers with the required precision, dont
output anything in addition to what you are asked to output in the output specification of the problem
statement. See this reading on testing: link.
Time limit exceeded. Your solution worked longer than the allowed time limit for some test case. If it
is a sample test case from the problem statement, or if you are solving Programming Assignment 1,
you will also see the input data and the correct answer. Otherwise, you wont know the input and the
correct answer. Check again that your algorithm has good enough running time estimate. Test your
program locally on the test of maximum size allowed by the problem statement and see how long it
works. Check that your program doesnt wait for some input from the user which makes it to wait
forever. See this reading on testing: link.
Memory limit exceeded. Your solution used more than the allowed memory limit for some test case. If it
is a sample test case from the problem statement, or if you are solving Programming Assignment 1,
21
you will also see the input data and the correct answer. Otherwise, you wont know the input and the
correct answer. Estimate the amount of memory that your program is going to use in the worst case
and check that it is less than the memory limit. Check that you dont create too large arrays or data
structures. Check that you dont create large arrays or lists or vectors consisting of empty arrays or
empty strings, since those in some cases still eat up memory. Test your program locally on the test of
maximum size allowed by the problem statement and look at its memory consumption in the system.
Cannot check answer. Perhaps output format is wrong. This happens when you output something
completely different than expected. For example, you are required to output word Yes or No, but
you output number 1 or 0, or vice versa. Or your program has empty output. Or your program outputs
not only the correct answer, but also some additional information (this is not allowed, so please follow
exactly the output format specified in the problem statement). Maybe your program doesnt output
anything, because it crashes.
Unknown signal 6 (or 7, or 8, or 11, or some other). This happens when your program crashes. It
can be because of division by zero, accessing memory outside of the array bounds, using uninitialized
variables, too deep recursion that triggers stack overflow, sorting with contradictory comparator, re-
moving elements from an empty data structure, trying to allocate too much memory, and many other
reasons. Look at your code and think about all those possibilities. Make sure that you use the same
compilers and the same compiler options as we do. Try different testing techniques from this reading:
link.
Internal error: exception... Most probably, you submitted a compiled program instead of a source
code.
Grading failed. Something very wrong happened with the system. Contact Coursera for help or write in
the forums to let us know.
22
make ones programs work, one must test them really well. Sometimes, the programs still dont work although
you tried really hard to test them, and you need to be both skilled and creative to fix your bugs. Solutions
to algorithmic problems are one of the hardest to implement correctly. Thats why in this Specialization you
will gain this important experience which will be invaluable in the future when you write programs which
you really need to get right.
It is crucial for you to learn to test and fix your programs yourself. In the real life, often there will be no
or only partial information about the failure of your program or service. Still, you will have to reproduce the
failure to fix it (or just guess what it is, but thats rare, and you will still need to reproduce the failure to
make sure you have really fixed it). When you solve algorithmic problems, it is very frequent to make subtle
mistakes. Thats why you should apply the testing techniques described in this reading to find the failing
test case and fix your program.
9.6 My solution does not pass the tests? May I post it in the forum and ask
for a help?
No, please do not post any solutions in the forum or anywhere on the web, even if a solution does not
pass the tests (as in this case you are still revealing parts of a correct solution). Recall the third item
of the Coursera Honor Code: I will not make solutions to homework, quizzes, exams, projects, and other
assignments available to anyone else (except to the extent an assignment explicitly permits sharing solutions).
This includes both solutions written by me, as well as any solutions provided by the course staff or others
(link).
9.7 My implementation always fails in the grader, though I already tested and
stress tested it a lot. Would not it be better if you give me a solution to
this problem or at least the test cases that you use? I will then be able to
fix my code and will learn how to avoid making mistakes. Otherwise, I do
not feel that I learn anything from solving this problem. I am just stuck.
First of all, you always learn from your mistakes.
The process of trying to invent new test cases that might fail your program and proving them wrong
is often enlightening. This thinking about the invariants which you expect your loops, ifs, etc. to keep and
proving them wrong (or right) makes you understand what happens inside your program and in the general
algorithm youre studying much more.
Also, it is important to be able to find a bug in your implementation without knowing a test case and
without having a reference solution. Assume that you designed an application and an annoyed user reports
that it crashed. Most probably, the user will not tell you the exact sequence of operations that led to a crash.
Moreover, there will be no reference application. Hence, once again, it is important to be able to locate a
bug in your implementation yourself, without a magic oracle giving you either a test case that your program
fails or a reference solution. We encourage you to use programming assignments in this class as a way of
practicing this important skill.
If you have already tested a lot (considered all corner cases that you can imagine, constructed a set of
manual test cases, applied stress testing), but your program still fails and you are stuck, try to ask for help
on the forum. We encourage you to do this by first explaining what kind of corner cases you have already
considered (it may happen that when writing such a post you will realize that you missed some corner cases!)
and only then asking other learners to give you more ideas for tests cases.
23