3.0:pandas【基础操作】

时间:2020-12-14 05:18:35

pandas 是基于numpy构件的强大的数据处理模块,其核心的数据结构有两个:Series 与 DataFrame

一:Series

  Series 是一种类似于表的东西,拥有索引(index)与其对应的值(value)

  1)创建Series:

    Sereies方法接收两个参数,第一个与value相关,第二个用来指定索引。而创建的方式有两种:

    一种为用两个list作为参数分别代表value和index的值[index参数不写则默认0开始自增长]

    另一种为dict作为第一参数,若不写第二参数,则其key变成index,value即是value,若有第二参数,则用第二参数元素作为index.[index对应不上的则被抛弃]

    import pandas as pd

 obj_1 = pd.Series([1,2,3,4])    #若不指定索引则默认为从零开始的自增长

     --->obj_1
      0 1
      1 2
      2 3
      3 4
      dtype: int64     obj_2 = pd.Series([1,2,3,4], index=['a','b','c','d'])  #指定索引     obj_2
    --->a 1
      b 2
      c 3
      d 4
      dtype: int64

创建方法一

     sdata = {'Ohio':3500,'Texas':7100,'Oregon':1600,'Utah':500}

     obj_3 = pd.Series(sdata)

     obj_3
    --->Ohio 3500
      Oregon 1600
      Texas 7100
      Utah 500
      dtype: int64          states = ['California','Ohio','Texas']     obj_4 = pd.Series(sdata,index=states)     obj_4
    --->California NaN
      Ohio 3500
      Texas 7100 #由于states列表并没有Oregen与Utah,故无法对应起来
      dtype: float64

创建方法二

  2) 索引

    obj_1.values     #调出所有元素值
    --->array([1, 2, 3, 4], dtype=int64)

    obj_1.index     #调出索引值
    --->Int64Index([0, 1, 2, 3], dtype='int64')

    #改变index值

    obj_4.index = ['bob','steve','jeff']    #注:若要改变index,数量必须与原本的数量相同,不能少也不能多

    obj_4
  
      bob NaN
      steve 3500
      jeff 7100
      dtype: float64

    obj_2['a']      #利用索引进行取值
    --->1

    obj_2[['c','b','a']]        #可以用索引一次取多个值,并且按其给定的顺序输出
    --->c 3
      b 2
      a 1
      dtype: int64

    'b' in obj_2      #检验索引是否存在
    --->True

二:DataFrame

  一种表格型的数据结构,每列可以是不同的数值类型,且它既有行索引,还有列索引,并且他们是平衡的

  1)创建DataFrame

    DataFram(data[,columns = ... , index = ...])

    注:若data为字典型数据,则keys自动变成columns,若data仅是列表类,columns与index都是默认0开始自增长的数

    

 data=[['ohio','nevada','nevada'],[2000,1000,1000],[1.5,1.7,3.6]]

     frame_1 = pd.DataFrame(data)

     frame_1
    0 1 2
      0 ohio nevada nevada
      1 2000 1000 1000
      2 1.5 1.7 3.6     frame_2 = pd.DataFrame(data,columns=['first','second','third'])     frame_2
     first second third #注意此处结果与使用字典时比较,这里一个list定义了一行,而字典的是一列
    0 ohio nevada nevada
    1 2000 1000 1000
    2 1.5 1.7 3.6         frame_2 = pd.DataFrame(data,columns=['first','second','third'],index=['one','two','three'])     frame_2
       first second third
    one ohio nevada nevada
    two 2000 1000 1000
    three 1.5 1.7 3.6

创建方法一

             data2 = {'states':['ohio','nevada','nevada'],'year':[2000,1000,1000],'pop':[1.5,1.7,3.6]}

     frame_4=pd.DataFrame(data2)

     frame_4
      pop states year
    0 1.5 ohio 2000
    1 1.7 nevada 1000
    2 3.6 nevada 1000     frame_5=pd.DataFrame(data2,index=['one','two','three'])     frame_5
      pop states year
    one 1.5 ohio 2000
    two 1.7 nevada 1000
    three 3.6 nevada 1000     

创建方法二

  2)索引

    同Series一样可以通过values与index属性查看这两个值

 In [62]: frame_4
Out[62]:
pop states year
0 1.2 ohio 2000
1 2.1 new state new year
2 3.6 nevada 1000 In [63]: frame_4.index
Out[63]: Int64Index([0, 1, 2], dtype='int64') In [64]: frame_4.index.name In [65]: frame_4.index
Out[65]: Int64Index([0, 1, 2], dtype='int64') In [66]: frame_4.values
Out[66]:
array([[1.2, 'ohio', 2000L],
[2.1, 'new state', 'new year'],
[3.6, 'nevada', 1000L]], dtype=object)

index/values属性

    通过对column的索引可以获取以Series的形式返回一列

 In [38]: frame_4
Out[38]:
pop states year
0 1.5 ohio 2000
1 1.7 nevada 1000
2 3.6 nevada 1000 In [39]: frame_4['pop']
Out[39]:
0 1.5
1 1.7
2 3.6
Name: pop, dtype: float64

    通过索引字段ix可以以Series形式返回一行的内容【实际上ix关键字可以实现两个方向上的选取,其接收两个参数,第一个取行,第二个取列,返回并集】

 In [40]: frame_4.ix[1]
Out[40]:
pop 1.7
states nevada
year 1000
Name: 1, dtype: object

 In [8]: frame_4.ix[1,:1]
 Out[8]:
 pop 1.7
 Name: 1, dtype: object

  3)赋值

    列赋值

 In [41]: frame_4['pop']=2.0

 In [42]: frame_4
Out[42]:
pop states year
0 2 ohio 2000
1 2 nevada 1000
2 2 nevada 1000

    行赋值

 In [44]: frame_4
Out[44]:
pop states year
0 2 ohio 2000
1 hello hello hello
2 2 nevada 1000

    通过Series进行赋值

 In [45]: val = pd.Series([1.2,2.0,3.6],index=[0,1,2])

 In [46]: frame_4['pop']=val

 In [47]: frame_4
Out[47]:
pop states year
0 1.2 ohio 2000
1 2.0 hello hello
2 3.6 nevada 1000
 In [48]: val_2 = pd.Series([2.1,'new state','new year'],index=['pop','states','y
ear'])
In [49]: frame_4.ix[1]=val_2 In [50]: frame_4
Out[50]:
pop states year
0 1.2 ohio 2000
1 2.1 new state new year
2 3.6 nevada 1000

    增与删

 In [52]: frame_4['stars']=['one','two','five']     #没有则直接新建

 In [53]: frame_4
Out[53]:
pop states year stars
0 1.2 ohio 2000 one
1 2.1 new state new year two
2 3.6 nevada 1000 five In [54]: del frame_4['stars'] In [55]: frame_4
Out[55]:
pop states year
0 1.2 ohio 2000
1 2.1 new state new year
2 3.6 nevada 1000

  4)转置:.T          [只是返回一个转置的副本,本身并不转置]

 In [56]: frame_4
Out[56]:
pop states year
0 1.2 ohio 2000
1 2.1 new state new year
2 3.6 nevada 1000 In [57]: frame_4.T
Out[57]:
0 1 2
pop 1.2 2.1 3.6
states ohio new state nevada
year 2000 new year 1000

.T