all repos — site @ 938af423d4595fc37071582577ec4f13abde3d84

source for my site, found at icyphox.sh

pages/blog/python-for-re-1.md (view raw)

  1---
  2template: text.html
  3title: Python for Reverse Engineering #1: ELF Binaries
  4subtitle: Building your own disassembly tooling for — that’s right — fun and profit
  5date: 2019-02-08
  6---
  7
  8While solving complex reversing challenges, we often use established tools like radare2 or IDA for disassembling and debugging. But there are times when you need to dig in a little deeper and understand how things work under the hood.
  9
 10Rolling your own disassembly scripts can be immensely helpful when it comes to automating certain processes, and eventually build your own homebrew reversing toolchain of sorts. At least, that’s what I’m attempting anyway.
 11
 12### Setup
 13
 14As the title suggests, you’re going to need a Python 3 interpreter before
 15anything else. Once you’ve confirmed beyond reasonable doubt that you do,
 16in fact, have a Python 3 interpreter installed on your system, run
 17
 18```console
 19$ pip install capstone pyelftools
 20```
 21
 22where `capstone` is the disassembly engine we’ll be scripting with and `pyelftools` to help parse ELF files.
 23
 24With that out of the way, let’s start with an example of a basic reversing
 25challenge.
 26
 27```c
 28/* chall.c */
 29
 30#include <stdio.h>
 31#include <stdlib.h>
 32#include <string.h>
 33
 34int main() {
 35   char *pw = malloc(9);
 36   pw[0] = 'a';
 37   for(int i = 1; i <= 8; i++){
 38       pw[i] = pw[i - 1] + 1;
 39   }
 40   pw[9] = '\0';
 41   char *in = malloc(10);
 42   printf("password: ");
 43   fgets(in, 10, stdin);        // 'abcdefghi'
 44   if(strcmp(in, pw) == 0) {
 45       printf("haha yes!\n");
 46   }
 47   else {
 48       printf("nah dude\n");
 49   }
 50}
 51```
 52
 53
 54Compile it with GCC/Clang:
 55
 56```console
 57$ gcc chall.c -o chall.elf
 58```
 59
 60
 61### Scripting
 62
 63For starters, let’s look at the different sections present in the binary.
 64
 65```python
 66# sections.py
 67
 68from elftools.elf.elffile import ELFFile
 69
 70with open('./chall.elf', 'rb') as f:
 71    e = ELFFile(f)
 72    for section in e.iter_sections():
 73        print(hex(section['sh_addr']), section.name)
 74```
 75
 76
 77This script iterates through all the sections and also shows us where it’s loaded. This will be pretty useful later. Running it gives us
 78
 79```console
 80› python sections.py
 810x238 .interp
 820x254 .note.ABI-tag
 830x274 .note.gnu.build-id
 840x298 .gnu.hash
 850x2c0 .dynsym
 860x3e0 .dynstr
 870x484 .gnu.version
 880x4a0 .gnu.version_r
 890x4c0 .rela.dyn
 900x598 .rela.plt
 910x610 .init
 920x630 .plt
 930x690 .plt.got
 940x6a0 .text
 950x8f4 .fini
 960x900 .rodata
 970x924 .eh_frame_hdr
 980x960 .eh_frame
 990x200d98 .init_array
1000x200da0 .fini_array
1010x200da8 .dynamic
1020x200f98 .got
1030x201000 .data
1040x201010 .bss
1050x0 .comment
1060x0 .symtab
1070x0 .strtab
1080x0 .shstrtab
109```
110
111
112Most of these aren’t relevant to us, but a few sections here are to be noted. The `.text` section contains the instructions (opcodes) that we’re after. The `.data` section should have strings and constants initialized at compile time. Finally, the `.plt` which is the Procedure Linkage Table and the `.got`, the Global Offset Table. If you’re unsure about what these mean, read up on the ELF format and its internals.
113
114Since we know that the `.text` section has the opcodes, let’s disassemble the binary starting at that address.
115
116```python
117# disas1.py
118
119from elftools.elf.elffile import ELFFile
120from capstone import *
121
122with open('./bin.elf', 'rb') as f:
123    elf = ELFFile(f)
124    code = elf.get_section_by_name('.text')
125    ops = code.data()
126    addr = code['sh_addr']
127    md = Cs(CS_ARCH_X86, CS_MODE_64)
128    for i in md.disasm(ops, addr):        
129        print(f'0x{i.address:x}:\t{i.mnemonic}\t{i.op_str}')
130```
131
132
133The code is fairly straightforward (I think). We should be seeing this, on running
134
135```console
136› python disas1.py | less      
1370x6a0: xor ebp, ebp
1380x6a2: mov r9, rdx
1390x6a5: pop rsi
1400x6a6: mov rdx, rsp
1410x6a9: and rsp, 0xfffffffffffffff0
1420x6ad: push rax
1430x6ae: push rsp
1440x6af: lea r8, [rip + 0x23a]
1450x6b6: lea rcx, [rip + 0x1c3]
1460x6bd: lea rdi, [rip + 0xe6]
147**0x6c4: call qword ptr [rip + 0x200916]**
1480x6ca: hlt
149... snip ...
150```
151
152
153The line in bold is fairly interesting to us. The address at `[rip + 0x200916]` is equivalent to `[0x6ca + 0x200916]`, which in turn evaluates to `0x200fe0`. The first `call` being made to a function at `0x200fe0`? What could this function be?
154
155For this, we will have to look at **relocations**. Quoting [linuxbase.org](http://refspecs.linuxbase.org/elf/gabi4+/ch4.reloc.html)
156> Relocation is the process of connecting symbolic references with symbolic definitions. For example, when a program calls a function, the associated call instruction must transfer control to the proper destination address at execution. Relocatable files must have “relocation entries’’ which are necessary because they contain information that describes how to modify their section contents, thus allowing executable and shared object files to hold the right information for a process’s program image.
157
158To try and find these relocation entries, we write a third script.
159
160```python
161# relocations.py
162
163import sys
164from elftools.elf.elffile import ELFFile
165from elftools.elf.relocation import RelocationSection
166
167with open('./chall.elf', 'rb') as f:
168    e = ELFFile(f)
169    for section in e.iter_sections():
170        if isinstance(section, RelocationSection):
171            print(f'{section.name}:')
172            symbol_table = e.get_section(section['sh_link'])
173            for relocation in section.iter_relocations():
174                symbol = symbol_table.get_symbol(relocation['r_info_sym'])
175                addr = hex(relocation['r_offset'])
176                print(f'{symbol.name} {addr}')
177```
178
179
180Let’s run through this code real quick. We first loop through the sections, and check if it’s of the type `RelocationSection`. We then iterate through the relocations from the symbol table for each section. Finally, running this gives us
181
182```console
183› python relocations.py
184.rela.dyn:
185 0x200d98
186 0x200da0
187 0x201008
188_ITM_deregisterTMCloneTable 0x200fd8
189**__libc_start_main 0x200fe0**
190__gmon_start__ 0x200fe8
191_ITM_registerTMCloneTable 0x200ff0
192__cxa_finalize 0x200ff8
193stdin 0x201010
194.rela.plt:
195puts 0x200fb0
196printf 0x200fb8
197fgets 0x200fc0
198strcmp 0x200fc8
199malloc 0x200fd0
200```
201
202
203Remember the function call at `0x200fe0` from earlier? Yep, so that was a call to the well known `__libc_start_main`. Again, according to [linuxbase.org](http://refspecs.linuxbase.org/LSB_3.1.0/LSB-generic/LSB-generic/baselib---libc-start-main-.html)
204> The `__libc_start_main()` function shall perform any necessary initialization of the execution environment, call the *main* function with appropriate arguments, and handle the return from `main()`. If the `main()` function returns, the return value shall be passed to the `exit()` function.
205
206And its definition is like so
207
208```c
209int __libc_start_main(int *(main) (int, char * *, char * *), 
210int argc, char * * ubp_av, 
211void (*init) (void), 
212void (*fini) (void), 
213void (*rtld_fini) (void), 
214void (* stack_end));
215```
216
217
218Looking back at our disassembly
219
220```
2210x6a0: xor ebp, ebp
2220x6a2: mov r9, rdx
2230x6a5: pop rsi
2240x6a6: mov rdx, rsp
2250x6a9: and rsp, 0xfffffffffffffff0
2260x6ad: push rax
2270x6ae: push rsp
2280x6af: lea r8, [rip + 0x23a]
2290x6b6: lea rcx, [rip + 0x1c3]
230**0x6bd: lea rdi, [rip + 0xe6]**
2310x6c4: call qword ptr [rip + 0x200916]
2320x6ca: hlt
233... snip ...
234```
235
236
237but this time, at the `lea` or Load Effective Address instruction, which loads some address `[rip + 0xe6]` into the `rdi` register. `[rip + 0xe6]` evaluates to `0x7aa` which happens to be the address of our `main()` function! How do I know that? Because `__libc_start_main()`, after doing whatever it does, eventually jumps to the function at `rdi`, which is generally the `main()` function. It looks something like this
238
239![](https://cdn-images-1.medium.com/max/800/0*oQA2MwHjhzosF8ZH.png)
240
241To see the disassembly of `main`, seek to `0x7aa` in the output of the script we’d written earlier (`disas1.py`).
242
243From what we discovered earlier, each `call` instruction points to some function which we can see from the relocation entries. So following each `call` into their relocations gives us this
244
245```
246printf 0x650
247fgets  0x660
248strcmp 0x670
249malloc 0x680
250```
251
252
253Putting all this together, things start falling into place. Let me highlight the key sections of the disassembly here. It’s pretty self-explanatory.
254
255```
2560x7b2: mov edi, 0xa  ; 10
2570x7b7: call 0x680    ; malloc
258```
259
260
261The loop to populate the `*pw` string
262
263```
2640x7d0:  mov     eax, dword ptr [rbp - 0x14]
2650x7d3:  cdqe    
2660x7d5:  lea     rdx, [rax - 1]
2670x7d9:  mov     rax, qword ptr [rbp - 0x10]
2680x7dd:  add     rax, rdx
2690x7e0:  movzx   eax, byte ptr [rax]
2700x7e3:  lea     ecx, [rax + 1]
2710x7e6:  mov     eax, dword ptr [rbp - 0x14]
2720x7e9:  movsxd  rdx, eax
2730x7ec:  mov     rax, qword ptr [rbp - 0x10]
2740x7f0:  add     rax, rdx
2750x7f3:  mov     edx, ecx
2760x7f5:  mov     byte ptr [rax], dl
2770x7f7:  add     dword ptr [rbp - 0x14], 1
2780x7fb:  cmp     dword ptr [rbp - 0x14], 8
2790x7ff:  jle     0x7d0
280```
281
282
283And this looks like our `strcmp()`
284
285```
2860x843:  mov     rdx, qword ptr [rbp - 0x10] ; *in
2870x847:  mov     rax, qword ptr [rbp - 8]    ; *pw
2880x84b:  mov     rsi, rdx             
2890x84e:  mov     rdi, rax
2900x851:  call    0x670                       ; strcmp  
2910x856:  test    eax, eax                    ; is = 0? 
2920x858:  jne     0x868                       ; no? jump to 0x868
2930x85a:  lea     rdi, [rip + 0xae]           ; "haha yes!" 
2940x861:  call    0x640                       ; puts
2950x866:  jmp     0x874
2960x868:  lea     rdi, [rip + 0xaa]           ; "nah dude"
2970x86f:  call    0x640                       ; puts  
298```
299
300
301I’m not sure why it uses `puts` here? I might be missing something; perhaps `printf` calls `puts`. I could be wrong. I also confirmed with radare2 that those locations are actually the strings “haha yes!” and “nah dude”.
302
303**Update**: It's because of compiler optimization. A `printf()` (in this case) is seen as a bit overkill, and hence gets simplified to a `puts()`.
304
305### Conclusion
306
307Wew, that took quite some time. But we’re done. If you’re a beginner, you might find this extremely confusing, or probably didn’t even understand what was going on. And that’s okay. Building an intuition for reading and grokking disassembly comes with practice. I’m no good at it either.
308
309All the code used in this post is here: [https://github.com/icyphox/asdf/tree/master/reversing-elf](https://github.com/icyphox/asdf/tree/master/reversing-elf)
310
311Ciao for now, and I’ll see ya in #2 of this series — PE binaries. Whenever that is.